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NASA MANAGEMENT PROBLEMS 


WEDNESDAY, MARCH 22, 2000 

U.S. Senate, 

Subcommittee on Science, Technology, and Space, 
Committee on Commerce, Science, and Transportation, 

Washington, DC. 

The Subcommittee met, pursuant to notice, at 2:32 p.m., in room 
SR-253, Russell Senate Office Building, Hon. Bill Frist, Chairman 
of the Subcommittee, presiding. 

OPENING STATEMENT OF HON. BILL FRIST, 

U.S. SENATOR FROM TENNESSEE 

Senator Frist. Good afternoon. I would like to welcome all of our 
guests here today as the Subcommittee on Science, Technology, and 
Space convenes this hearing on the current management chal- 
lenges at NASA. 

This afternoon, although we hope to discuss where we have been 
in the past, we also want to take a look at where we are going in 
the future. 

First, let us take a look at what has brought us to today’s hear- 
ing. The year 1999 proved to be a very difficult and challenging one 
for the agency. 

We have read the reports on workers searching for misplaced 
Space Station tanks in a landfill; loose pins in the Shuttle’s main 
engine; failure to make English-metric conversions causing the fail- 
ure of a $125 million mission to Mars; two-time use of rejected 
seals on a Shuttle’s turbo-pumps; $1 billion of cost overruns on the 
prime contract for the Space Station, with calls from the Inspector 
General at NASA for improvement in NASA’s oversight; workers 
damaging the main antenna on the Shuttle for communication be- 
tween mission control and the orbiting Shuttle; urgent repair mis- 
sion to the Hubble Telescope; approximately $1 billion invested in 
an experimental vehicle and currently no firm plans for its first 
flight, if it flies at all; and the lack of long-term planning for the 
Space Station, an issue on which the Subcommittee has repeatedly 
questioned NASA. 

This Subcommittee recognizes and appreciates the technical chal- 
lenges and hurdles NASA must address to make its missions suc- 
cessful. However, based upon our initial review of the various in- 
vestigation reports on these problems, the real culprit may be man- 
agement. We cannot and should not dismiss good basic manage- 
ment as an essential component of success. It still gets back to the 
fundamentals of planning, of leading, of organizing and of control- 
ling. 


( 1 ) 
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Furthermore, we must ensure that every individual not only un- 
derstands their job, but also performs it well. 

Regardless of whether NASA’s mantra is “Faster, Better, Cheap- 
er,” “Mission Success First,” or some other phrase, “back to basics” 
should be — must be an integral part of the agency’s infrastructure. 

The bottom line is that we need to confirm that proper manage- 
ment is in place and functioning as it should be. 

We cannot proceed until we have done everything we can to en- 
sure that safety is at the forefront of every NASA endeavor. We 
must realize that human lives are at stake each time the Shuttle 
is launched, and therefore, we must take every precaution to guar- 
antee the astronauts return home safely. 

It is necessary that we have this hearing today. For $14 billion 
a year, the American taxpayers deserve better. So with the over- 
sight responsibilities of this Committee, we hope to further discuss 
with our witnesses today how to get NASA back on track. 

We are alarmed by the sheer volume of the reports that we will 
discuss today. Their recommendations are numerous and far reach- 
ing. It will take time for us to fully review these recommendations. 
In the meantime, I look forward to receiving NASA’s implementa- 
tion plan from these collective reports later this year. 

Later in the hearing, we will be referring to, I am sure, a UPI 
article from yesterday that I read last night, that alleges that 
NASA currently holds the finding of the Young report, originally 
scheduled to be released earlier this month, but now delayed until 
final approval by the White House. 

The content of the story, I am sure we will discuss, and I note 
that a press release has been released by NASA this afternoon in 
response. 

I do want, in advance, to thank all of our witnesses for coming 
before the Committee today. I would especially like to commend the 
individuals who participated on the various review teams. Your 
work is clearly crucial to our oversight process. 

[The prepared statement of Senator Frist follows:] 

Prepared Statement of Hon. Bill Frist, 

U.S. Senator from Tennessee 

I would like to welcome all of our guests here today as the Subcommittee on 
Science, Technology, and Space convenes this hearing on the current management 
challenges at National Aeronautics and Space Administration (NASA). 

This afternoon, although we hope to discuss where we’ve been in the past, we also 
hope to discuss where we’re going. 

First, let’s take a look at what has brought us to today’s hearing. The year 1999 
proved to be very difficult for the agency. We have read the reports on: 

• Workers searching for misplaced Space Station tanks in a landfill; 

• Loose pins in the Shuttle’s main engine; 

• Failure to make English-metric conversions causing the failure of a $125 million 
mission to Mars; 

• Two-time use of “rejected” seals on Shuttle’s turbopumps; 

• $1 billion of cost overruns on the prime contract for the Space Station with calls 
from the Inspector General at NASA for improvement in NASA’s oversight; 

• Workers damaging the main antennae on the Shuttle for communication be- 
tween mission control and the orbiting Shuttle; 

• Urgent repair mission to the Hubble Telescope; 
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• Approximately $1 billion invested in an experimental vehicle and currently no 
firm plans for its first flight, if it flies at all; and 

• The lack of long-term planning for the Space Station, an issue on which the 
Subcommittee has repeatedly questioned NASA. 

This Subcommittee recognizes and appreciates the technical challenges and hur- 
dles NASA must address to make their missions successful. However, based upon 
our initial review of the various investigation reports on these problems, the real 
culprit is management. We cannot and should not dismiss good basic management 
as an essential component of success. It still gets back to the fundamentals of plan- 
ning, leading, organizing and controlling. Furthermore, we must ensure that every 
individual not only understands their job, but also performs it well. 

Regardless of whether NASA’s mantra is “Faster, Better, Cheaper,” “Mission Suc- 
cess First,” or some other leading phrase, “back to the basics” should be an integral 
part of the agency’s infrastructure. The bottom line is that we need to confirm that 
proper management is in place and functioning as it should be. 

We cannot proceed until we have done everything we can to ensure that safety 
is at the forefront of every NASA endeavor. We must realize that human lives are 
at stake each time the Shuttle is launched and, therefore, we must take every pre- 
caution to guarantee the astronauts return home safely. 

It is unfortunate that we have to have this hearing today, but its necessity is 
vital. Furthermore, for $14 billion a year, the American taxpayers deserve better. 
So with the oversight responsibilities of this Committee, we hope to further discuss 
with our witnesses here today how to get NASA back on track. 

We are alarmed by the sheer volume of the reports that we will discuss today. 
Their recommendations are numerous and far reaching. It will take time for us to 
fully review of these recommendations. In the meantime, I look forward to receiving 
NASA’s implementation plan from these collective reports later this year. 

Last night I read an alarming article that alleges that NASA currently holds the 
finding of the Young report, originally scheduled to be released earlier this month, 
but now delayed until final approval by the White House. If the content of the new 
stories is indeed true, this is very disturbing, and there is sure to be significant fall- 
out from the facts the report will uncover. I intend to focus some of my questions 
towards this subject later in the hearing. 

But first I want to thank each of our witnesses for appearing before the Com- 
mittee today. I would especially like to commend the individuals who participated 
on the various review teams. Your work is crucial to our oversight process. 

For opening statements, I will turn to Senator Hutchison. 

Senator McCain, would you like to proceed? 

Senator McCain. I — I would like to go after Senator Hutchison. 
Thank you. 

Senator Frist. Senator Hutchison. 

STATEMENT OF HON. KAY BAILEY HUTCHISON, 

U.S. SENATOR FROM TEXAS 

Senator Hutchison. Thank you, Mr. Chairman. 

And I want to say thank you to the Chairman of the Committee. 
I am happy to step aside if you have other things. 

Senator McCain. No. Please go on. 

Senator Hutchison. OK. Let me thank Senator Frist, as the 
Chairman of this Subcommittee, for convening the hearing. I think 
Senator Frist is certainly one of the most credible members of the 
Senate on this subject, and he is the perfect Chairman of this Sub- 
committee. 

And I know that his goal is the same as mine, and that is that 
we have a healthy NASA, because we know there are mistakes. We 
also know that in any endeavor whose mission is to push the enve- 
lope into new horizons is going to have mistakes along the way. 

But also, I think Senator Frist is right to ask the question so 
that we can strengthen NASA to make sure that it does meet its 
mission and continues to push the envelope of space. 



4 


It is interesting that 4 years ago today the Space Shuttle 
Atlantis was engaged in our nation’s third linkup with Russia’s Mir 
Space Station. A 6-hour space walk in the Shuttle’s cargo bay was 
conducted by two American astronauts while docked with Mir, and 
additionally the Space Shuttle dropped off Shannon Lucid, the first 
American woman to live on Mir. 

This historic journey signaled the cooperation that was forged be- 
tween the United States and an international partner such as Rus- 
sia. 

I would like at some point in this hearing, for Mr. Goldin to com- 
ment on that international partnership with Russia. And I think 
we certainly should question if it is in our best interest to continue 
that partnership, and I hope you will speak to that. 

We certainly should not lose sight of all that NASA has meant 
for our country. We should learn from our mistakes, but we should 
not be deterred in our cause. NASA’s cause is nothing less than 
pushing the boundaries of our knowledge. 

Today’s hearing will examine many of the management issues of 
NASA, its successes and its failures. 

NASA will present us with three reports that have been con- 
ducted to review the problems, including the loss of the Mars Polar 
Lander, Mars Climate Orbiter, the Wide Field Infrared Explorer 
and the Deep Space 2. 

During the nineties, “Faster, Better, Cheaper,” was embraced as 
the mantra of NASA. Perhaps the mantra for the next century 
should be “Faster, Cheaper, and Better Defined,” or should it be, 
“Faster, Better-defined, and Not So Cheap”? 

I think we have got to admit that we have pushed the limits. 
NASA has tried very hard to meet the Congressional mandate that 
it be more efficient. You have dramatically reduced the cost of 
space flight while launching four times as many missions during 
the nineties. 

NASA is right to be ambitious. America expects that. But the 
American people also expect Congress to provide NASA with the 
resources the space agency needs to carry out its mission without 
having to cut corners, especially on manned space flight. As the 
Chairman said — and I would agree — space safety must not be com- 
promised. 

I have a particular interest in the Space Shuttle. The McDonald 
report focuses on our Shuttle program and has laid forth rec- 
ommendations. These have been addressed by the contractor, 
United Space Alliance. 

Certainly some of the questions raised in the report need to be 
continually reviewed. However, it is in the interest of all involved, 
including the contractor, that safety remain the top priority. 

So, Mr. Chairman, I also saw the report through B.B.C. and UPI 
that you saw, which I hope that Mr. Goldin will address regarding 
the Polar Lander. 

And with that, I will say thank you for calling the hearing, and 
I look forward to hearing from the witnesses. 
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Senator Frist. Thank you, Senator Hutchison. 

Senator McCain. 

STATEMENT OF HON. JOHN McCAIN, 

U.S. SENATOR FROM ARIZONA 

Senator McCain. I thank you, Senator Frist. Thank you for your 
stewardship of this Subcommittee, and for the outstanding work 
that you are doing. 

Over the past year, I have continually been amazed by reports 
coming out of NASA about the mission failures and program 
delays. I am glad the Committee is examining these issues today. 

I understand that four of the reports on these incidents will be 
discussed, while other reports will be released later this month, 
which may require another Subcommittee hearing, as you men- 
tioned, Senator Frist. 

The extent of mismanagement noted in these reports is some- 
what startling. For years, I have expressed concern about the man- 
agement, and I repeat my concern at this time. 

I am pleased to see that GAO is testifying along with the other 
witnesses. It is my understanding that the GAO will offer prelimi- 
nary findings regarding the Shuttle work force and safety issues. 
And I obviously appreciate their efforts. 

In review of the various reports presented today, some of the 
overarching themes are apparent: staff complacency; inadequately 
trained personnel; lack of effective internal communication; and 
staff not following established procedures. 

The funding impact of failures and delays is quite startling, esti- 
mated to be in the billions of dollars. Some costs we cannot even 
calculate. But we do know that: the International Space Station 
cost increases the amount to $9 billion; the two failed Mars mis- 
sions cost $360 million; and X-33, the experimental reusable 
launch vehicle, the future of which is uncertain, has a cost to date 
of approximately $1 billion. 

We know it will take some time for NASA to digest all of the rec- 
ommendations that will be made here. As such, the Committee 
looks forward to a formal response from NASA very soon. 

On a specific matter, which you have already referred to, Mr. 
Chairman, a press article reported that NASA knew of a fatal de- 
sign flaw in the Mars Polar Lander even before its arrival on Mars, 
but that NASA withheld this information from the public. 

The article goes on to say that the future Young report on the 
Mars Polar Lander will be “devastating.” I have requested a copy 
of this report from NASA, but NASA has indicated the report can- 
not be released until cleared by the White House. 

It has been brought to my attention that NASA earlier today 
“categorically” denied this report. 

I had originally hoped that the Young report would be a part of 
today’s discussions, but the report was delayed from its original re- 
lease date earlier this month. 

If the media reports are true, then the trust that is vital between 
the government and citizens has been violated and this warrants 
a very serious examination of how the agency operates. I hope that 
Mr. Goldin will specifically address this issue. 

I want to thank you very much, Mr. Chairman. 
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I went to see a movie with my children last weekend, and the 
movie was called, “Mission to Mars.” 

I do not know if you have had the opportunity to see it. I think 
it is a very interesting and exciting movie. And obviously the work 
and effort that NASA has been involved in has captured the imagi- 
nation of all Americans, young and old. 

But we also have a responsibility obviously to the taxpayers. On 
numerous occasions, this Committee has some — in some ways been 
bypassed, in direct approaches to the appropriations Committees — 
not the first organization that has done that. 

I think it is overdue perhaps that this Committee exercise more 
rigorously our oversight of NASA in light of recent events. And I 
hope that in working with you and other members of the Com- 
mittee on both sides of the aisle, we can achieve that oversight in 
a more effective and more responsive way to the American tax- 
payer. 

For example, there should be some cost caps on some of these 
programs. They have continuously been increased over many years. 
We have been assured almost on an annual basis there would be 
certain cost limitations, and then those costs continue to increase. 

We have not demanded restraint in spending, but we have de- 
manded accountability in cost estimates that continue to be exceed- 
ed year after year. 

So I thank you, Mr. Chairman. I thank the witnesses for being 
here today. And, it is great to be back. 

Thank you, Mr. Chairman. 

Senator Frist. Thank you, Senator McCain. 

[The prepared statement of Senator McCain follows:] 

Prepared Statement of Hon. John McCain 
U.S. Senator from Arizona 

First, let me thank Senator Frist for holding this hearing today and for his con- 
tinual leadership of this Subcommittee. 

Over the past year, I have continually been amazed by the reports coming out of 
NASA about the mission failures and program delays. I am glad the Committee is 
examining these issues today. I understand that four of the reports on these inci- 
dents will be discussed while other reports will be released later this month. 

The extent of mismanagment noted in these reports is very startling. For years 
now, I have expressed concern regarding NASA’s management and I repeat that 
concern at this time. 

I am pleased to see GAO is testifying along with the other witnesses. It is my 
understanding that GAO will offer preliminary findings regarding Shuttle workforce 
and safety issues and I applaud them for doing so. 

In review of the various reports presented today, some of the overarching themes 
are apparent: staff complacency, inadequately trained personnel, lack of effective in- 
ternal communication, and staff not following established procedures. 

The funding impact of failures and delays is staggering, estimated to be in the 
billions of dollars. Some costs we can’t even calculate. But, we do know that: 

— the International Space Station cost increases amount to $9 billion; 

— the two failed Mars missions cost $360 million; and 

— X-33, the experimental reusable launch vehicle, the future of which is uncer- 
tain, has a cost to date of approximately $1 billion. 

We know it will take some time for NASA to digest all of the recommendations 
that will be made here. As such, the Committee looks forward to a formal response 
from NASA very soon. 

On a specific matter, yesterday, a press article reported that NASA knew of a 
fatal design flaw in the Mars Polar Lander even before its arrival at Mars, but that 
NASA withheld this information from the public. The article goes on to say that the 
future Young report on the Mars Polar Lander will be “devastating” to NASA. I 
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have requested a copy of this report from NASA, but NASA has indicated the report 
cannot be released until cleared by the White House. 

It has been brought to my attention that NASA, earlier today, “categorically” de- 
nied this report. 

I had originally hoped that the Young report would be a part of today’s discus- 
sions, but the report was delayed from its original release date earlier this month. 

If the media reports are true that NASA withheld critical information from the 
public and elected officials, then the trust that is vital between this government and 
its citizens has been violated and warrants a very serious examination of how the 
agency operates. During today’s hearing I hope Mr. Goldin will specifically address 
this matter. 

Senator Frist, again I thank you for your leadership on these issues and look for- 
ward to working with you and Senator Breaux in completing the NASA Authoriza- 
tion conference with the House. 

Senator Frist: This positioning of me here, and you there — just 
a few more days, and you will be back up here. That is all right. 
You cannot stay away too long. That is right. 

[Laughter.] 

Senator McCain. Thank you. 

Senator Frist. Senator Burns. 

STATEMENT OF HON. CONRAD BURNS, 

U.S. SENATOR FROM MONTANA 

Senator Burns. Thank you very much, Mr. Chairman. And that 
is the only chair you get to lean back though on. I noticed how he 
uses that very well. 

[Laughter.] 

Senator BURNS. Mr. Chairman, thank you, and thank you for 
holding this hearing today. I think it is very apropos, because of 
what has become a swirl of information that is flying around the 
country, and most of it has been on the negative side. 

But I would tell you that any time that we deal with the un- 
known and the sciences and especially in our R&D, and our work 
in that area, there is always a failure or two along the way. And 
they get a lot more notice than all of the successes. 

I was struck by an article that I read. The difference between 
this country and, let us say, our counterparts, our Russian friends, 
all the years that we were in the space business, we were taking 
the technology that has been developed and the imagination of 
NASA and what they have learned and everything that they did, 
we had a way of taking that technology and transferring that into 
the private sector for the use of all American people. 

Our friends in Russia did not do that. They took all their tech- 
nology and put it in a safe, and they held it there because they 
were afraid for anybody else to find out or do anything with it. 
And, therefore, you got a big powerful country over there that had 
as — at one time probably as — technologically was an equal with us. 
But they kept it in a safe, and they did not grow with it, and we 
did. 

All the time, we were transferring that technology into the pri- 
vate sector, and we were using it and become a part of our economy 
in this country, both in the medical field, the science field, the 
pharmaceuticals, all these where we have had great technological 
advances due to our space program. 

The other day, I mentioned that we had good news that we had 
found the Mars mission. It was in North Dakota. But I say that 
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in kind of a joke, but basically we have got some undiscovered 
places there too. 

But nonetheless, we are not going to find all of the things that 
we try, and all the missions we go on are not going to be a success. 

And — and even though what — it is the negative parts that — that 
happen in NASA that get the ink, it is the successes that we 
should put in a list and find out who is ahead in the ball game. 

So Mr. Chairman, I think oversight is very, very good, because 
it allows the agency to come before this Committee and to lay it 
out exactly what they know and their plans for the future, because 
we are still a society that reaches out. We are still a society that 
goes into the unknown. 

Our curiosity is as strong as it ever has been, and sometimes we 
are allowed up because of technology and what we know and what 
we do not know, and what we find out. 

So I want to congratulate you. You know, there are different pro- 
grams that are sponsored by NASA across this country with our 
learning institutions and our young people, is absolutely dynamic, 
because they capture the imagination of young people aspiring into 
the sciences, into the mathematics, into the physics part of our 
every day life. 

And let us face it, that is the last frontier out there, and we lead. 
And not every mission is going to be successful, but I would say 
there is a learning process on every mission that is probably more 
than you can ever expect to buy by money. So I am interested to 
see this. 

I have got a bill I have got to get over on Energy, Mr. Chairman, 
but thank you for having this hearing and thank you for asking the 
hard questions. 

And I thank the leadership at NASA for coming today, because 
this is the way we solve our problems. This is the way we attack 
our challenges. And we do have challenges ahead of us. 

And I thank the Chairman very much. 

Senator Frist. Thank you, Senator Burns. 

As is customary, each witness will be given 5 minutes to present 
his or her prepared oral testimony. And Mr. Goldin will have as 
much time as he would like. The witnesses’ entire written testi- 
mony will be made a part of the official record. And we will begin 
the first panel. 

Welcome, Mr. Goldin, Administrator, National Aeronautics and 
Space Administration. I think the opening comments reflect where 
our initial approach is, and so feel free to deviate from your — your 
presented testimony based either in response now or at the time 
of questioning. 

STATEMENT OF DANIEL S. GOLDIN, ADMINISTRATOR, 
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 

Mr. Goldin. Thank you, Mr. Chairman. I would like to read my 
prepared oral statement and then address the issue that you and 
Senator McCain brought up. 

Senator Frist. That would be fine, thank you. 

Mr. Goldin. Mr. Chairman, good afternoon, and it is a good 
afternoon. Thank you for the opportunity to appear before you 
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today regarding the recent failure of two Mars missions and delays 
in other NASA programs. 

At NASA, we push the boundaries. We spearhead revolutionary 
change. And on occasion, we experience failure. We do not flinch 
from challenge. We learn from our failures. And, we support the 
Committee’s objective of examining us. This hearing is part of a 
great democratic process of open dialog and I, personally, welcome 
it. 

To begin, we must not forget that these failures have occurred 
in the context of a magnificent record of NASA accomplishments. 
I am proud of our record of having saved nearly $40 billion from 
planned budgets for the American taxpayer and doing more for 
less. 

Since 1992, NASA has launched 146 payloads valued at a total 
of $18 billion. Of this number, 136 payloads were successful. Our 
total losses amounted to ten payloads measured at about a half bil- 
lion, or less than 3 percent of the total payloads launched. 

Planetary spacecraft, once launched twice a decade at a cost 
measured in billions are now routinely launched each year at a 
small fraction of that cost. This is world-class performance by any 
reasonable standard. 

Indeed, NASA has experienced some severe disappointments and 
problems this last year, as you pointed out, the back-to-back losses 
of the Mars Climate Orbiter and the Mars Polar Lander and the 
Deep Space 2 probes, wiring problems in a hydrogen tank leak in 
the Shuttle, and a failure of the X-33 composite tank to pass a 
qualification test. We are paying close attention to these failures, 
examining them, searching for root causes, and recommending 
changes. 

Mr. Chairman, let me also say that I believe strongly that delay- 
ing launches is not a failure. While we are vigilant about unneces- 
sary cost growth, NASA is all too aware that rushing to launch 
when mission success issues have not been resolved increases the 
potential for failure and loss. 

In fact, NASA is deliberately — and I underline deliberately — en- 
couraging a culture change in which any person can speak up to 
stop a program or launch if it is not ready or if it unsafe for the 
hardware or crew. 

During the last week, NASA released reports of the Shuttle Inde- 
pendent Assessment Team, the Mars Climate Orbiter mishap in- 
vestigation board, and the Faster, Better, Cheaper review. 

The report of Tom Young’s team will be released next week, fol- 
lowed by the X-33 review in the next few months. I will refrain 
from discussing them today, but would be pleased to return to ad- 
dress them after they have finalized. 

I might point out that all these reviews were invoked by NASA, 
not by outside sources. Some of the common findings from these re- 
ports are, one, in some cases, program managers did not employ 
the risk management tools that would have alerted them to the in- 
adequacy of their budget, schedule and performance margins, with 
the consequence that risk levels were higher than anticipated, par- 
ticularly in planetary missions, with fixed launch dates, launch ve- 
hicles, and science payloads. 
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Two, at a time of major cultural change and a rapid increase in 
the number of programs underway, some programs were staffed 
with next-generation program managers, who had not been ade- 
quately trained and mentored, both in terms of resources for les- 
sons from the past experiences and the use of revolutionary new 
tools and techniques, which I will talk about later. 

There have been instances in which problems have been ob- 
served, but not effectively communicated. And in some cases, em- 
ployees have not adhered to sound engineering and management 
principles, particularly with respect to timely, independent peer re- 
view of scientific and technical approaches being used to achieve 
program goals. 

The cold facts of these reports do not convey the hopes and aspi- 
rations of the NASA/JPL teams that they would achieve what most 
people believe is impossible. And these failures are not a basis for 
reversing our course in pursuit of revolutionary change. NASA will 
not reverse our course. 

As has been the case at various times throughout the agency’s 
40-year history, we are committed to learn everything we can from 
these losses, alter our approach and with the dialog with Congress, 
where it is prudent to do so, move on forward. 

As I stated before this Committee in 1997, “At NASA, we do not 
shy away from difficult missions. We have tremendous successes, 
but we also have failures, and we learn from them. Often the learn- 
ing we do from our failures leads to greater successes than we 
originally imagined. That is why it is important for the young peo- 
ple to see NASA take risks. We want them to see that we are not 
afraid of failure and that they should not be either.” 

I want to publicly salute the entire NASA team, civil servants 
and contractors, and especially the courageous Mars 1998 team for 
their perseverance and courage they have displayed in the face of 
change and transition. 

Success cannot be prescribed only by returning to past tech- 
niques for conducting missions. Success in the past was often 
achieved at great expense, using large government contractor 
teams and massive documentation to verify the design and imple- 
mentation of complex systems. This nation cannot afford to do busi- 
ness in that manner, nor do we need to. 

Revolutionary new technologies and approaches to engineering 
are emerging. Success in the future will be achieved by using tech- 
nology to enable small teams geographically dispersed, operating in 
virtual environments, using new tools such as soft computing, neu- 
ral nets and learning systems to enable more fault-tolerant sys- 
tems. NASA is a leader in developing collaborative engineering en- 
vironments and design tools. 

These new directions will in the future enhance the quality and 
productivity of Faster, Better, Cheaper approaches. This strategy is 
a key element of our fiscal 2001 budget, and I seek the support of 
this Committee in implementing this strategy. 

Mr. Chairman, NASA has a strong commitment to excellence. 
Our response to failure is to take out a magnifying glass, examine 
what went wrong and why, and take corrective action. 

We disseminate the lessons learned to our work force and con- 
tractors. A better NASA team emerges through the process, galva- 
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nized to meet the challenges with renewed energy and resolve. This 
is a self-critical process, but essential to future success. 

In the near future, we will have compiled an integrated analysis 
of the corrective actions we will implement in response to the find- 
ings and recommendations of all the reports. We look forward to 
the future opportunity to discuss them with you. 

And in closing, I make this promise on behalf of the entire NASA 
team: NASA is resolved to make a great record even greater. 

Thank you and I am prepared to respond to your questions. 

[The prepared statement of Mr. Goldin follows:] 

Prepared Statement of Daniel S. Goldin, Administrator, 

National Aeronautics and Space Administration 

Mr. Chairman and Members of the Subcommittee: 

I am pleased to be here today in response to your request that I provide testimony 
on several Agency programs, and I congratulate you for holding this hearing that 
focuses on NASA’s failures. As you know, my own management style is to focus on 
what we need to do better, even while recognizing that almost all of what NASA 
does is done successfully. We learn from correcting our mistakes, by identifying the 
lessons learned from our endeavors and then ensuring that other programs apply 
those lessons. NASA is a research agency operating at the cutting-edge of science 
and technology. Even though we strive for excellence, we also must be aware that 
space launch vehicles and spacecraft must operate in an environment that is ex- 
tremely unforgiving. 

We have recognized these challenges ourselves, and, on our own initiative, have 
proactively initiated a series of reviews. At the same time, I salute the NASA team; 
they are wonderful men and women experimenting with change. I welcome this op- 
portunity to give you our preliminary assessment today of the several reviews that 
have been conducted and the reports that have been issued. We intend to reflect 
further, and would be pleased to return later this summer to outline our conclu- 
sions. 

Mr. Chairman, I understand that the Subcommittee’s focus today is upon manage- 
ment issues, but I would like to remind the Subcommittee that NASA’s record of 
accomplishment has been outstanding. I am proud of our record of having saved ap- 
proximately $40 billion from planned budgets for the American taxpayer, and doing 
more for less. As testimony to the performance of the NASA team, since 1992, 
NASA has launched 146 payloads valued at a total of $18 billion. Of this number, 
136 payloads were successful. We believe our success is a testimony to NASA’s 
strong systems engineering capability. Our total losses amounted to 10 payloads, 
measured at about $1/2 billion, or less than 3 percent. The Mars 1998 failures alone 
accounted for 60 percent of this loss. Planetary spacecraft, which used to be 
launched twice a decade at a cost measured in the billions, are now routinely 
launched each year at a small fraction of that cost. This is world class performance 
by any reasonable standard. I would like to recount a few of the successes of the 
past year: 

• We began the year with the successful launch of Deep Space One, a mission 
to test 12 revolutionary technologies necessary for the future of space science. 

• STS-93, commanded by the first female Shuttle commander, deployed the 
Chandra X-ray Observatory; 

• Deployment of the EOS series of satellites was begun, with the launch of 
Landsat 7, followed by QuikSCAT, Terra, the flagship EOS satellite, and 
AcrimSAT. 

• The X-33 program made considerable progress by beginning testing of the 
world’s first aero-spike engine, scheduled to be completed this summer; 

• ISS hardware to support the first 12 ISS assembly missions was completed and 
stands poised for launch at the Kennedy Space Center. 

• On STS-103, we repaired the Hubble Space Telescope (HST), and HST has now 
found a value for how fast the universe is expanding, after 8 years of pains- 
taking measurement; and, 
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• STS-99, the Shuttle Radar Topography Mission (SRTM) achieved a break- 
through in remote sensing that will produce topographic maps of Earth 30 
times as precise as the best global maps in use today. 

As you know, 1999 was marked by continuing launch vehicle failures that directly 
and indirectly impacted NASA programs. The Russian Proton failures have had a 
significant impact on the launch of the Russian Service Module Zvezda. The Japa- 
nese, Europeans, and the United States struggled to achieve safe and reliable access 
to space. Just two weeks ago, the Sea Launch vehicle experienced a failure. And, 
in 1999, NASA also experienced some severe disappointments and problems: the 
back-to-back losses of the Mars Climate Orbiter and the Mars Polar Lander and the 
Deep Space-2 probes, wiring problems and a hydrogen leak in the Shuttle, and a 
failure of the X-33 composite tank to pass a qualification test. 

You have specifically requested that I address the Mars Program failures as well 
as delays in Space Shuttle launches, the International Space Station, X-33, and 
Gravity Probe B. You also asked me to specifically address the manner in which 
NASA is using systems engineering to facilitate the successful conduct of these mis- 
sions. 

A number of independent reviews have been commissioned to examine these prob- 
lems, search for root causes, and recommend changes. NASA worked closely with 
the Department of Defense and others on the Broad Area Review of DOD space 
launch failures. In July 1999, NASA requested that the former Mars Pathfinder 
Project manager conduct a study of NASA’s approach to Faster, Better, Cheaper 
(FBC) program management, and make recommendation on a set of principles, 
tools, and processes for ensuring NASA’s success in adapting the FBC approach to 
project planning, management and execution. In response to ascent anomalies ob- 
served on STS-93, NASA, in September 1999, chartered a Space Shuttle Inde- 
pendent Assessment Team (SIAT). The objective of the SIAT was to undertake a 
technical review of Shuttle maintenance and operations, and to bring to the Space 
Shuttle, where applicable, best practices of the external commercial and military 
aviation community. In October 1999, NASA chartered a Mars Climate Orbiter 
(MCO) Mishap Investigation Board to assess the actual or probable cause of the 
MCO mission failure. Following the loss of the Mars Polar Lander, the charter of 
the Board was expanded to investigate a wide range of space science programs, and 
to make recommendations regarding NASA project management based upon lessons 
learned from the expanded review. In November 1999, NASA and Lockheed Martin 
formed a review team to assess the causes and implications of the X-33 Liquid Hy- 
drogen Composite Tank failure. 

Additionally, following the failures of the Mars Climate Orbiter, the Mars Polar 
Lander, and two Deep Space 2 microprobes, I determined that an in-depth review 
of the entire Mars Program should be undertaken by independent observers. The 
Mars Program Independent Assessment Team (MPIAT) was chaired by A. Thomas 
Young. The MPIAT report is expected to be released by the end of March, and the 
independent review of the X-33 tank failure is scheduled to be completed in the 
coming weeks. I will refrain from commenting upon either of those reports today. 

As you can see, NASA has taken the initiative to commission these reviews and 
examine ourselves. Within the last two weeks, the reports of the Shuttle Inde- 
pendent Assessment Team, the Mars Climate Orbiter Mishap Investigation Board, 
and the Faster, Better, Cheaper Review have been issued. The reports will be made 
part of today’s hearing record, and you will hear from the leaders of each team 
today. Some of the common findings from these reports are: 

• in many cases, program managers did not employ the risk management tools 
that would have alerted them to the inadequacy of their budget, schedule and 
performance margins, with the consequence that risk levels were higher than 
anticipated, particularly in missions with fixed launch dates, fixed launch vehi- 
cles, and fixed science payloads; 

• at a time of major cultural change and a rapid increase in the number of pro- 
grams underway, programs were staffed with next-generation program man- 
agers without, in some instances, ensuring that they had been adequately 
trained and mentored, both in terms of resources for lessons learned from past 
experiences and the use of revolutionary new tools and techniques. 

• there have been instances in which problems have been observed, but not effec- 
tively communicated; and, 

• in some cases, employees have not adhered to sound engineering and manage- 
ment principles and Agency standards and procedures with respect to timely, 
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independent peer review of scientific and technical approaches being used to 
achieve program goals. 

In summary, these findings convey a less than desired effectiveness of our project 
management and systems engineering practices with respect to the failed missions. 

These reports, and the pending Mars Program Independent Assessment Report, 
will provide a set of findings and recommendations that can serve as a strong foun- 
dation for executing the changes in NASA program architecture, management, sys- 
tems engineering, design, and execution needed in the future. As has been the case 
at various times throughout this Agency’s 40-year history, NASA is committed to 
learn everything we can from these losses, alter our approach where it is prudent 
to do so, and move on. NASA has undertaken a journey toward revolutionary 
change with the strong support of the Administration and Congress. 

These failures are not a basis for reversing our present course in pursuit of revo- 
lutionary change. And NASA will not reverse course. We are committed to fixing 
our shortcomings and moving forward. However, I believe it would be unwise to 
issue a prescription for mission success to the NASA workforce. They must have the 
freedom to innovate and learn. At the same time, there are fundamental consider- 
ations that must be taken into account. We must ensure that clear and independent 
peer review of scientific and technical approaches is done. It is essential that men 
and women being placed in new positions of responsibility and new technical assign- 
ments be trained and mentored, not only in terms of retrospective experiences and 
leadership, but prospectively as well, in terms of what we are already learning from 
revolutionary new tools and techniques. Criteria for mission success must be clearly 
articulated. Resource estimates must be commensurate with mission goals. Margins 
must be adequate. And there must be clear lines of communication up and down 
the management chain, allowing for open discussion. These fundamental consider- 
ations were not applied as they should have been in the Mars 1998 missions. As 
I stated before this Committee in 1997, “At NASA we do not shy away from difficult 
missions. NASA has tremendous successes, but we also have failures and we learn 
from them. Often the learning we do from our failures leads to greater successes 
than we originally imagined. That is why it is important for young people to see 
NASA take risks. We want them to see that we are not afraid of failure, and that 
they should not be either.” 

There is no prescription that can eliminate the chance of failure. And success can- 
not be prescribed just by returning to past techniques for conducting missions. Im- 
position of prescriptions for mission success runs the risk of suffocating openness 
to change, risk taking, and willingness to fail. Prescription does not work because 
it does not allow for innovation and incorporation of new concepts and technology. 
We must recognize that we are at the leading edge of a transition toward a new 
generation of scientists and engineers. We need to examine failures experienced by 
NASA, other Government agencies, U.S. industry, and throughout Europe, Japan, 
and Russia. Within the broader context of the advanced development and science 
base of the United States, we are witnessing a demographic change. The engineer- 
ing experience base of Apollo and the Cold War is retiring from the work environ- 
ment, at the same time that NASA is facing very tough competition from dot.com 
organizations and the high tech industry for the best engineers and scientists 
emerging from our universities. Simultaneously, we are witnessing the emergence 
of new technologies and new approaches to engineering. Soft computing, neural net- 
works, and learning systems, are being incorporated into design and operations to 
enable more fault-tolerant systems rather than reverting to techniques of the past. 
The United States must be at the forefront of these new approaches to engineering, 
and must have a new engineering education curriculum to prepare its new engi- 
neers. NASA is fully engaged in these new directions in engineering and design 
tools, in information technology, nanotechnology, biotechnology and Intelligent Syn- 
thesis Environments. A key element of the Intelligent Synthesis Environment is Ad- 
vanced and Collaborative Engineering Environments. These engineering environ- 
ments were highlighted in the Phase I June, 1999 report of the National Research 
Council on Advanced Engineering Environments as a historic opportunity to create 
facilities and tools in collaboration with industry and academia to design, analyze, 
and conduct performance trade studies of complex systems with unprecedented lev- 
els of effectiveness in terms of time, cost and labor. 

NASA has taken proactive steps with the development of such tools, methods and 
facilities at NASA Centers since the early 1990’s. The Project Design Center at JPL, 
and the Integrated Mission Design Center at GSFC are two examples of the applica- 
tion of such environments early in the formulation process to define requirements, 
develop design concepts, conduct performance trade studies, assess technology bene- 
fits, and provide parametric cost data on complex NASA missions. These environ- 
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merits also provide an opportunity to capture lessons learned in systems engineering 
designs and analysis. All of these are responsive to some of the concerns raised in 
the MCO and FBC reports and clearly represent a visionary step to take full advan- 
tage of the information, design and analysis tools revolution. The Agency recognizes 
that further integration into the physical and cultural infrastructure of the Agency 
is needed. The Aero-Space Technology Enterprise has already taken steps with its 
Lead Centers to develop business plans to address such concerns. 

I want to salute the Mars 1998 team. They pushed the envelope. The mistakes 
made can and will be corrected. Learning from those errors will enable NASA to 
strive for even greater accomplishments in the future. The entire NASA team, civil 
servants and contractors, has done an incredible job in the face of change and tran- 
sition to Faster, Better, Cheaper. 

Mr. Chairman, let me also say that I believe strongly that delays in launch are 
not a measure of failure. Your concern about delays, and the consequent costs, is 
well taken. However, NASA is all too aware that rushing to launch when mission 
success issues have not been resolved increases the potential for failure. In fact, 
NASA is deliberately encouraging a culture change in which any person can speak 
up to stop a program or launch if it is not ready, or if it is unsafe in terms of hard- 
ware or crew. We are modifying NASA’s performance goals and renegotiating con- 
tracts to remove the emphasis upon schedule, and refocus emphasis upon better de- 
sign and quality. 

I salute our employees for their determination to delay launches of the Shuttle 
this past year until they were convinced we could safely launch. There are other 
instances, some involving delays of spacecraft valued at more than $1 billion, in 
which we have employed new tools and techniques with which our employees have 
demonstrated that they are empowered to identify problems prior to launch in order 
to fully resolve those issues. 

• In the case of AXAF, NASA delayed shipping the spacecraft to verify software 
and faulty printed wiring boards were safe to fly. 

• In the case of the Hubble Space Telescope servicing mission, we delayed the 
launch to complete inspection, maintenance and repair of Shuttle wiring. 

• In the case of Terra, we delayed the launch to ensure that the launch vehicle 
propulsion system was safe following a previous Atlas HAS failure. 

• In the case of Deep Space-1, the team at the Jet Propulsion Laboratory had 
problems; they delayed the launch, added resources, and fixed it. 

• In the case of the SRTM mission, a delay to upgrade the Shuttle allowed for 
additional analysis and simulations to enhance safety and mitigate risk, helping 
us to better deal with an in-flight anomaly. The ultimately stunning results will 
benefit a variety of civil and national security interests. 

Mr. Chairman, NASA is in the process of addressing the various recommendations 
included in these reports. 

I have directed the NASA Chief Engineer to work with the four NASA Enterprises 
and NASA’s Centers to develop an integrated implementation plan in response to 
recommendations emanating from all these reports for improvement in Program/ 
Project Management and systems engineering and for the improvement of NASA’s 
institutional infrastructure with respect to people, process tools, and technology. Ac- 
tions will be defined in consultation with Enterprise managers, the NASA Academy 
of Program/Project Leadership, a training arm of the Agency’s Office of Human Re- 
sources, the Program Management Council Working Group, an Agency-wide team 
of experienced project managers and system engineers and the various review 
groups. To accomplish this, the Chief Engineer will form an internal team of experts 
to assess all recommendations and develop Agency-wide approaches for improving 
the success of the Faster, Better, Cheaper class of missions. By August 2000, spe- 
cific actions will be defined to ensure consistency of best practices during the formu- 
lation and implementation of programs and projects. Promulgation and deployment 
of the resultant actions will begin immediately thereafter. As I indicated earlier in 
this statement, the team will complete their proposed improvements by midsummer. 
I anticipate that those actions will result in revisions to: 

• Agency policy and requirements for program/project management regarding 
staffing, systems engineering, risk management, peer reviews and other best 
practices as well as leadership plans; 

• Agency approaches to attracting, developing, and retaining key engineering and 
project management skills; 
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• increased utilization of information technology-based tools to aid project execu- 
tion during all phases; and, 

• heightened attention to development of future mission technology needs. 

Mr. Chairman, I would like to outline a series of proactive steps that NASA has 
undertaken during the past 2 years that are intended to strengthen our systems en- 
gineering capability and which, when fully operational, will help address many of 
the recommendations included in the various reports. These steps reflect NASA’s 
commitment to world-class systems engineering throughout Agency programs. 

1. NASA deployed an Agency-wide NASA Policy Directive 7120.4, in November 
1996, for Program/Program Management, and NASA Procedures and Guide- 
lines NPG 7120.5, in April 1998, for NASA Program and Project Management 
Processes and Requirements. The processes and requirements defined by 
these documents are an integral part of the Agency-wide management system 
established to meet goals of NASA’s Strategic Plan. This management system 
provides the framework to govern the formulation, approval, implementation 
and evaluation of Agency Programs and Projects. 

2. A NASA-wide Core Competency assessment was undertaken in FY 1999 to 
define the requisite NASA workforce skills in all critical areas to accomplish 
Agency missions. One outcome of this activity was reflected in the Adminis- 
tration’s FY 2001 budget request to add additional civil service staffing, fol- 
lowing a 20-25 percent staffing reduction over the last several years. 

3. An Agency-wide working group has formulated a revised policy on program/ 
project management focused on enhancing Risk Management and the estab- 
lishment, in October 1999, of a Systems Management Office at each Center, 
led largely by senior project managers and systems engineers, to ensure re- 
quirement traceability and adherence to sound systems engineering practices. 
Additionally, a focused effort has been undertaken to safely reduce civil serv- 
ants assigned to operational tasks and to redeploy those resources to Re- 
search and Development activities compatible with the Agency’s strategic 
thrust. 

4. An Agency-wide focus on safety was implemented last summer. The motto 
“Mission Success Starts with Safety” is intended to ensure that the NASA 
and contractor workforce remain vigilant in keeping safety (including the 
safety of ground and space assets) the #1 core value. As part of this con- 
tinuing focus, NASA, in concert with the Aerospace Safety Advisory Panel, 
is highlighting opportunities to design for safety. A renewed emphasis will 
be placed on Failure Modes and Effects Analysis (FMEA), fault tree analysis, 
and probabilistic risk analysis in all of our projects and programs. 

5. The position of Deputy Chief Engineer for Systems Engineering was estab- 
lished in February 2000, and filled with a highly experienced person, in order 
to ensure increased attention to sound systems engineering practices 
throughout the Agency. Responsibilities of this position include the develop- 
ment of the vision, strategies and objectives for the development and mainte- 
nance of a world class engineering capability. This includes assessing the dis- 
cipline and systems engineering workforce (quality, quantity, capability, re- 
cruitment, training, life long learning, work experience, and organization), 
enabling tools, facilities and methods, and the development of action plans 
for continuous improvement. 

6. An Engineering Excellence Working Group has been established to develop 
the vision, strategies and objectives for the development and maintenance of 
a world class engineering capability throughout the Agency. As part of the 
Engineering Excellence initiative, the Chief Engineer is formalizing an Agen- 
cy-wide Systems Engineering Working Group (SEWG). The SEWG will work 
closely with the Engineering Management Council in guiding the assessment 
of the discipline and systems engineering workforce, enabling tools, facilities 
and methods, and the development of action plans for continuous improve- 
ment. 

7. NASA is placing increased emphasis on performing rigorous independent 
verification and validation of mission success-related software by enhancing 
the capability and responsibility of the NASA IV&V Facility. 

8. For each of the 26 missions scheduled for launch in 2000, a rigorous inde- 
pendent “Red Team” review has been conducted to ensure that cost and 
schedule considerations have not inappropriately influenced prudent risk de- 
cisions. Some of these reviews have already led to launch delays because of 
concerns raised. Additional risk mitigation measures stimulated by these re- 
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views have already demonstrated enhanced success on the Shuttle Radar To- 
pography Mission (SRTM). 

9. In order to improve the approach to independent assessment of projects, the 
Chief Engineer has been tasked to better integrate the full set of Agency, En- 
terprise, program and project reviews to assure effective balance of perform- 
ance, cost, schedule, and risk considerations by the project and appropriate 
awareness of those considerations by management. 

Mr. Chairman, I understand that you are considering introducing legislation that 
would require NASA to develop a systems engineering plan and implement it for 
every mission. We believe that appropriate responses to recent mission failures, par- 
ticularly the planetary failures, must be the product of a comprehensive evaluation, 
to ensure that both the root causes and contributing causes are addressed. All the 
steps I have outlined above are designed to produce an integrated Agency response 
to report findings and to simultaneously strengthen our program management. We 
do not believe that success can be prescribed with legislation. We know that you 
care about the success of NASA’s program, and that you want to help. Rather than 
pursuing a legislated prescription for systems engineering, we propose instead that 
you permit NASA to complete our assessment and provide you the result of our inte- 
grated response by late summer. 

I know that you and the other Members of this Subcommittee share NASA’s objec- 
tive to secure the maximum return on the investment of the American taxpayer in 
cutting-edge research and technology. I again commend you for focusing your atten- 
tion on our recent mission losses, so that we can have a full and open dialogue on 
how we intend to address them. NASA remains fundamentally committed to revolu- 
tionary change so as to provide our Nation the highest quality space and aero- 
nautics program. I have appended to my statement detailed information concerning 
the reports of the SIAT, the MCO Mishap Investigation Board, and the Faster, Bet- 
ter, Cheaper Review, as well as detailed information concerning program status of 
the Space Shuttle, International Space Station, X-33 and Gravity Probe B pro- 
grams, as requested in your letter of invitation. 

Thank you. I would be pleased to respond to your questions. 


Enclosure 

Mars Climate Orbiter Failure 

The Mars Climate Orbiter (MCO) Failure Mishap Investigation Board was for- 
mally established by NASA’s Associate Administrator for Space Science (OSS) on 
October 15, 1999. 

The MCO Mission objective was to orbit Mars as the first interplanetary weather 
satellite and provide a communications relay for the Mars Polar Lander (MPL) 
which was due to reach Mars in December 1999. The MCO was launched on Decem- 
ber 11, 1998, and was lost sometime following the spacecraft’s entry into Mars occul- 
tation during the Mars Orbit Insertion (MOl) maneuver. The spacecraft’s carrier 
signal was last seen at approximately 09:04:52 UTC on Thursday, September 23, 
1999. 

The Board was established to gather information, analyze, and determine the 
facts, as well as the actual or probable cause(s) of the MCO Mission Failure Mishap 
in terms of (1) dominant root cause(s), (2) contributing cause(s), and (3) significant 
observations and to recommend preventive measures and other appropriate actions 
to preclude recurrence of a similar mishap. 

An immediate priority for NASA was the safe landing on Mars on December 3, 
1999, of the Mars Polar Lander (MPL) spacecraft, then en route to Mars. The 
Board’s investigation was conducted recognizing the time-criticality of the MPL 
landing, and the activities the MPL mission team needed to perform to successfully 
land the MPL spacecraft on Mars. Hence, the Board’s first report was to focus on 
any lessons learned from the MCO mission failure in order to help assure MPL’s 
safe landing on Mars. The Board completed its first report, which was accepted, ap- 
proved and released by the Associate Administrator for Space Science and the Asso- 
ciate Administrator for Safety and Mission Assurance on November 10, 1999. 

On January 3, 2000, the Associate Administrator for Space Science revised the ob- 
jectives of the Board’s second and final report to broaden the area of investigation 
beyond the MCO failure. The Board was to investigate a wide range of space science 
programs and to make recommendations regarding project management within 
NASA, based upon reviewing lessons learned from this broader list of programs. 

The Board was also asked to address additional MCO findings and recommenda- 
tions not related to MPL (and thus not reported in the first report), the ideal project 
management process to achieve “Mission Safety First,” the current project manage- 
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ment process and where improvements are needed, recommendations for bridging 
the gap between the current and ideal projects, and metrics for measuring project 
performance regarding mission safety. The Board completed its final report, which 
was accepted, approved and released by the Associate Administrator for Space 
Science and the Associate Administrator for Safety and Mission Assurance on 
March 13, 2000. 

Summary of Contents and Major Recommendations/Findings Contained 
in the First Report of MCO Mishap Investigation Board, Released Novem- 
ber 10, 1999 

The first Board report focused on any aspects of the MCO mishap that had to be 
addressed in order to contribute to the Mars Polar Lander’s safe landing on Mars. 
The Mars Polar Lander (MPL) entry-descent-landing sequence was scheduled for 
December 3, 1999. The Board determined that the root cause for the loss of the 
MCO spacecraft was the failure to use metric units in the coding of a ground soft- 
ware file, used in trajectory models. 

During the 9-month journey from Earth to Mars, propulsion maneuvers were peri- 
odically performed to remove angular momentum buildup in the on-board reaction 
wheels (flywheels). These Angular Momentum Desaturation (AMD) events occurred 
10-14 times more often than was expected by the operations navigation team. This 
was due to the fact that the MCO solar array was asymmetrical relative to the 
spacecraft body as compared to Mars Global Surveyor (MGS) which had symmet- 
rical solar arrays. This asymmetric effect significantly increased the Sun-induced 
(solar pressure-induced) momentum buildup on the spacecraft. The increased AMD 
events, coupled with the fact that the angular momentum (impulse) data was in 
English units, rather than metric units, resulted in small errors being introduced 
in the trajectory estimate over the course of the 9-month journey. At the time of 
Mars insertion, the spacecraft trajectory was approximately 170 kilometers lower 
than planned. As a result, MCO either was destroyed in the atmosphere or re-en- 
tered heliocentric space after leaving Mars’ atmosphere. 

While mistakes occur in spacecraft projects, sufficient processes are normally in 
place to identify such mistakes before they become critical to mission success. Unfor- 
tunately, for MCO, the root cause was not caught by the processes in-place within 
the MCO project. 

A summary of the contributing causes and recommendations for MPL are listed 
below. 

Contributing Causes: 

1. undetected mis-modeling of spacecraft velocity changes; 

2. navigation team unfamiliar with spacecraft; 

3. trajectory correction maneuver number 5 not performed; 

4. system engineering process did not adequately address transition from devel- 
opment to operations; 

5. inadequate communications between project elements; 

6. inadequate operations navigation team staffing; 

7. inadequate training; and, 

8. verification and validation process did not adequately address ground soft- 
ware. 

Recommendations for MPL: 

• the consistent use of units throughout the MPL spacecraft design and oper- 
ations; 

• conduct software audit for specification compliance on all data transferred be- 
tween JPL and Lockheed Martin Astronautics; 

• verify Small Forces models used for MPL; 

• compare prime MPL navigation projections with projections by alternate navi- 
gation methods; 

• train Navigation Team in spacecraft design and operations; 

• prepare for possibility of executing trajectory correction maneuver number 5; 

• establish MPL systems organization to concentrate on trajectory correction ma- 
neuver number 5 and entry, descent, and landing operations; 

• take steps to improve communications; 

• augment Operations Team staff with experienced people to support entry, de- 
scent, and landing; 
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• train entire MPL Team and encourage use of Incident, Surprise, Anomaly proc- 
ess; 

• develop and execute systems verification matrix for all requirements; 

• conduct independent reviews on all mission critical events; 

• construct a fault tree analysis for remainder of MPL mission; 

• assign overall Mission Manager; 

• perform thermal analysis of thrusters feedline heaters and consider use of pre- 
conditioning pulses; and, 

• reexamine propulsion subsystem operations during entry, descent, and landing. 

Summary of Contents and Major Recommendations/Findings Contained in 
the Report on Project Management in NASA, by the MCO Mishap Investiga- 
tion Board, released March 13, 2000 

Building upon the lessons learned from the MCO, and a review of 7 other failure 
investigation board results, the Board’s Report on Project Management in NASA 
lays out a new vision for NASA programs and projects — to improve NASA mission 
success within the context of the “Faster, Better, Cheaper” paradigm. This vision, 
“Mission Success First,” entails a new NASA culture and new methods of managing 
projects. 

The Board’s recommendation is that, to proceed with this culture shift, mission 
success must become the highest priority at all levels of the program/project and the 
institutional organization. The Board found that the institutional organizations 
were not appropriately engaged in assuring mission success. The Board recommends 
that all individuals should feel ownership and accountability, not only for their own 
work, but for the success of the entire mission. The Board asserted that, because 
people working on a project are the primary element of the mission-success equa- 
tion, a new emphasis on people must be addressed across NASA programs. 

Examining the current state of NASA’s program and project management environ- 
ment, the Board found that a significant infrastructure of processes and require- 
ments is already in place to enable robust program and project management. How- 
ever, these processes have not been adequately implemented within the context of 
“Faster, Better, Cheaper.” 

The MCO mission was conducted under NASA’s “Faster, Better, Cheaper” philos- 
ophy, developed in recent years to enhance innovation, productivity, and cost-effec- 
tiveness of America’s space program. The “Faster, Better, Cheaper” paradigm has 
successfully challenged project teams to infuse new technologies and processes that 
allow NASA to do more with less. The success of “Faster, Better, Cheaper” is tem- 
pered by the fact that some projects and programs have put too much emphasis on 
cost and schedule reduction (the “Faster” and “Cheaper” elements of the paradigm). 
At the same time, they have failed to instill sufficient rigor in risk management 
throughout the mission lifecycle. These actions have increased risk to an unaccept- 
able level on these projects. 

The Report summarized lessons learned from the September 1999 loss of the 
MCO spacecraft. The Board’s analysis of the mishap concluded that program/project 
breakdowns occurred in 5 key areas: 

• systems engineering; 

• project management; 

• institutional involvement; 

• communication among project elements; and, 

• mission assurance. 

The Report then compared these breakdowns with other failed NASA missions — 
as well as with a long history of successful NASA missions — and from that analysis 
outlined a formula for future mission success, termed “Mission Success First.” “Mis- 
sion Success First” is a comprehensive project management strategy for improving 
the likelihood of mission success in every NASA endeavor. It addresses elements of 
project management that require greater attention throughout NASA: 

• renewing the focus on choosing and training the right personnel; 

• establishing and monitoring disciplined project processes; 

• ensuring proper project execution with active participation of NASA institu- 
tional line management; and, 
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• aggressively developing and maintaining leading-edge technology. 

Among the recommendations in the Board’s Report on Project Management in 
NASA are: 

• improved system engineering processes; 

• better, more thorough reviews; 

• improved risk assessment and management; 

• stronger teamwork and communications among all parties; 

• improved process for reporting problems; 

• operations involvement from the outset; and, 

• use of a checklist formulated by the Board as a guide for project managers and 
review panels (see Attachment 1). 

Spear Report on Improved Faster Better Cheaper Project Management 

The Faster, Better, Cheaper (FBC) concept of project management was initiated 
by NASA in the early 1990’s to challenge project managers of smaller, non-human 
spaceflight projects to use innovative approaches to reduce the development time of 
projects from 8-10 years to 3 years, and to development cost from billions to hun- 
dreds of millions. A corollary challenge was to reduce the size and complexity of 
spacecraft, such that singular mission failures would not significantly impact overall 
program objectives, if multiple smaller spacecraft were designed and built to accom- 
plish the same mission previously accomplished by single large spacecraft. The pri- 
mary Centers responsible for these types of spacecraft are the Jet Propulsion Lab- 
oratory (JPL) and NASA’s Goddard Space Flight Center. 

The Mars Pathfinder was one of the first FBC projects that had extensive visi- 
bility and was a resounding success. The Project was accomplished for about $250 
million, developed and launched in approximately 3 years, and successfully landed 
on Mars on July 4, 1997. The project was managed by JPL under the leadership 
of Tony Spear. 

In early 1999, after the completion of several FBC projects, NASA recognized that 
the tools and processes for the formulation and implementation of FBC were vari- 
able between projects, and that an assessment of best practices would be useful to 
document and promulgate across NASA Centers. The Department of Defense had 
also expressed interest in FBC processes. As a result, NASA’s Chief Engineer re- 
quested that Tony Spear assemble a team to review FBC with the objective of mak- 
ing recommendations on a set of principles, tools and processes for ensuring NASA’s 
success in adopting the FBC approach to NASA project planning, management and 
execution. The NASA FBC Task Final Report was released on March 13, 2000. 

Major recommendations of the NASA FBC Task Final Report are: 

• develop and maintain “Mission Risk Signatures” with mitigation plans; 

• certify FBC project teams as to experience and expertise; 

• teach FBC Lessons Learned and Rules of Engagement to all Centers; 

• develop a Project Performance Metric Checklist which is updated at the yearly 
Independent Review; 

• empower an independent check of project success criteria; 

• strike a better balance between challenge and risk; 

• increase priority on people acquisition, motivation and training; 

• assign a person at Headquarters responsible for advanced technology infusion 
into projects; 

• strike a better balance between empowerment and assessment; 

• improve teaming between NASA, industry and universities; 

• increase priority of university involvement in space missions; and, 

• increase use of information technology tools. 

Space Shuttle Independent Assessment Report 

As a result of ascent anomalies experienced on STS-93 in July 1999, NASA Asso- 
ciate Administrator for Space Flight, Joseph H. Rothenberg, on September 7, 1999, 
chartered a Space Shuttle Independent Assessment Team (SIAT) to review Space 
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Shuttle systems and maintenance practices. The SIAT was led by Dr. Henry McDon- 
ald, Director, NASA Ames Research Center, with a team comprised of NASA, con- 
tractor, and DOD personnel. 

The SIAT began work on October 4, 1999 and concluded their activities with a 
written report, submitted to the Associate Administrator for Space Flight on March 
7, 2000. 

The SIAT focused their review on 11 technical areas: avionics; human factors; hy- 
draulics; hypergols and auxiliary power unit; problem reporting and tracking proc- 
ess; propulsion; risk assessment and management; safety and mission assurance; 
software; structures; and, wiring. The team examined NASA practices, Space Shut- 
tle anomalies, and civilian and military aeronautical experience. NASA’s goal for the 
SIAT study was to bring to Space Shuttle maintenance and operations processes a 
perspective from the best practices of the external aviation community and, where 
applicable or appropriate, apply these practices to the Space Shuttle. The SIAT Re- 
port was released on March 9, 2000. 

The SIAT made 81 specific Recommendations in the 11 Technical Areas they re- 
viewed; 4 recommendations were dispositioned by NASA prior to the STS-103 
Hubble Servicing Mission. The SIAT summarized their recommendations in 9 
issues, listed in the Executive Summary: 

1. NASA must support the Space Shuttle Program (SSP) with the resources and 
staffing necessary to prevent the erosion of flight-safety critical processes 

2. The past success of the Shuttle program does not preclude the existence of 
problems in processes and procedures that could be significantly improved. 

3. The SSP’s risk management strategy and methods must be commensurate 
with the ‘one strike and you are out’ environment of Shuttle operations. 

4. SSP maintenance and operations must recognize that the Shuttle is not an 
‘operational’ vehicle in the usual meaning of the term. 

5. The SSP should adhere to a ‘fly what you test / test what you fly’ method- 
ology. 

6. The SSP should systematically evaluate and eliminate all potential human 
single point failures. 

7. The SSP should work to minimize the turbulence in the work environment 
and its effects on the workforce. 

8. The size and complexity of the Shuttle system and of the NASA/contractor 
relationships place extreme importance on understanding, communication, 
and information handling. 

9. Due to the limitations in time and resources, the SIAT could not investigate 
some Shuttle systems and/or processes in depth. An independent group may 
be required to examine these other areas and should be tasked with review- 
ing the Shuttle program’s disposition of SIAT findings and recommendations. 

The SIAT divided the remaining 77 recommendations into the following cat- 
egories: 

• 37 recommendations identified as “Short-Term” (solutions required prior to 

making more than 4 more Shuttle flights); 

• 30 recommendations identified as “Intermediate” (solutions required prior to 

January 1, 2001); and, 

• 10 recommendations identified as “Long-Term” (solutions required prior to Jan- 
uary 1, 2005). 

NASA’s Johnson Space Center, the Lead Center for Human Space Flight and the 
Space Shuttle Program, is reviewing and evaluating the SIAT recommendations, 
and will formulate a plan or response, as appropriate, for each over the next several 
weeks. 

NASA’s goal for the SIAT review, as with previous independent assessments of 
the Space Shuttle, has been to identify opportunities to improve safety. It should 
be noted that the SIAT Report fully endorsed the continuation of Space Shuttle 
flights after disposition of the Team’s immediate recommendations. The SIAT docu- 
mented many positive elements during the course of their interviews with the Space 
Shuttle NASA/contractor workforce. Particularly noteworthy were the observations 
dealing with the skill, dedication, commitment and concern for astronaut safety and 
the entire Space Shuttle workforce. The SIAT report will provide additional input 
to the full range of activities already underway associated with Space Shuttle safety 
investments, including upgrades, maintainability, processes for Shuttle safety, and 
quality control. 
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Space Shuttle Workforce 

As NASA continues to assemble the International Space Station and support the 
infrastructure and upgrades to the Space Shuttle program as well as Expendable 
Launch Vehicle (ELV) commitments over the next 5 years, the workload will in- 
crease steadily. Internal and external workforce assessments have convinced NASA 
management that NASA Human Space Flight (HSF) civil service FTE targets must 
be adjusted. From internal reviews, such as NASA’s Core Capabilities Study, to ex- 
ternal evaluations by the Aerospace Safety Advisory Panel (ASAP) and the Space 
Shuttle Independent Assessment (SIAT), it has become apparent that the HSF 
workforce required immediate revitalization. Five years of buyouts and downsizing 
have led to serious skill imbalances and an overtaxed core workforce. As more em- 
ployees have departed, the workload and stress remaining have increased, with a 
corresponding increase in the potential for impacts to operational capacity and safe- 
ty. HSF Centers will begin to accelerate hiring in FY 2000, in order to address im- 
mediate critical skill shortfalls. After the initial hiring of 500 new personnel across 
the 4 HSF Centers in FY 2000, HSF workforce trends will begin a one-for-one re- 
placement process and will allow HSF Centers to attain a steady state in civil serv- 
ice employment by FY 2001. NASA will continue to monitor HSF Center hires and 
attrition, ensuring that workforce skill balances are achieved and maintained. 

NASA will work with the Office of Management and Budget, in the coming 
months, to conduct a personnel review with an eye toward the future. This review 
will assess management tools and innovative approaches for personnel management 
that might best equip NASA to evolve and adapt our civil service workforce in the 
future. This will be particularly important as NASA continues our transition from 
operations to a focus on advancing the frontier with cutting edge research and de- 
velopment in science and technology. 

ISS Cost Status 

Last year, NASA testified before the Congress that the FY 2000 budget would pro- 
vide stability throughout the assembly of the ISS, allowing us to uphold our commit- 
ment to our International Partners on the ISS program, while providing critical con- 
tingency capabilities. This has indeed been the case. Compared to the FY 2000 
budget, the FY 2001 budget request reflects an overall reduction in the budget and 
runout estimates through FY 2005 of about $1.2 billion. Roughly $0.8 billion of this 
reduction is due to the movement of funding for the Phase 2 production of the ISS 
Crew Return Vehicle (CRV) to the Science, Aeronautics and Technology budget ac- 
count. The FY 2002-2005 funding estimates for the CRV will reside in that account 
pending a decision in the next 2 years on whether to proceed with an X-38-based 
CRV design. This decision will be made in the context of broader decisions that 
NASA and the Administration will make regarding future space transportation ar- 
chitectures. There was also an approximate $0.4 billion reduction in other ISS fund- 
ing, over 5 years, to fund Agency needs and other high priority activities such as 
the Bioastronautics initiative. 

While the 5-year funding profile for ISS has decreased in the FY 2001 budget, 
overall development costs are projected to increase. This growth, as in past years, 
is driven primarily by projected delays in reaching Development Complete. Develop- 
ment Complete is the point at which the ISS crew complement can be increased 
from 3 to 6 crew. Our current estimate is that the Development Complete schedule 
milestone will occur between Fall 2004-Fall 2005, with the projected cost in the 
range of $23-25 billion. Our estimate is that Assembly Complete schedule milestone 
will occur between May 2005-November 2006, with the projected cost in the range 
of $24-26 billion. These estimates do not reflect the full cost of contingency reserve 
for additional development effort and Shuttle costs that would be required to accom- 
modate a partner or partners having difficulty meeting ISS commitments. 

NASA has kept the Committee briefed on the challenges facing NASA and our 
International Partners on the ISS program. Both U.S. and Russian difficulties con- 
tributed to last year’s schedule delay. The Russian delays were caused by a Proton 
launch failure investigation. The planned July 2000 launch of the Service Module 
is now about a year later than projected in March 1999. While there has been much 
discussion about the state of readiness about our Russian partner, NASA has also 
experienced schedule delays. U.S. launch schedules supporting the ISS have slipped 
as a result of the wiring safety stand-down of the Shuttle fleet. Development and 
testing of U.S. elements has proceeded somewhat more slowly than expected. How- 
ever, the current Service Module launch schedule date provides several months of 
schedule margin for U.S. assembly flights. 

At about this time last year, our Prime contractor reassessed their estimated level 
of overrun at completion of the ISS development contract. At the time, they had 
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completed about 80 percent of the developmental effort, and their estimate of a $986 
million overrun represented about 11 percent growth. Due to the level of increase 
in their estimate, and the fact that the development program was coming to closure, 
NASA initiated several additional independent analyses to establish confidence in 
the new Boeing estimate and to reassess Boeing’s performance management proc- 
esses. One of these steps was to request the NASA Inspector General (IG) to provide 
their assessment of the performance management and Prime costs. The IG report 
highlighted that Boeing continued to make optimistic estimates of their overrun. 
NASA continues to budget to a level higher than the Boeing estimate. The prime 
contract will continue to make hardware deliveries this year, as the cost to go on 
the development contract decreases significantly. 

Gravity Probe B 

Gravity Probe B is the relativity gyroscope experiment being developed by NASA 
and Stanford University to test two extraordinary, unverified predictions of Albert 
Einstein’s general theory of relativity. The experiment is intended to measure, very 
precisely, tiny changes in the direction of spin of 4 gyroscopes contained in a sat- 
ellite orbiting at a 400-mile altitude directly over the poles. The gyroscopes are de- 
signed to be so free from disturbance that they will provide an almost-perfect space- 
time reference system. They will measure how space and time are warped by the 
presence of the Earth, and, more profoundly, how the Earth’s rotation drags space- 
time around with it. These effects, though small for the Earth, have far-reaching 
implications for the nature of matter and the structure of the Universe. Since the 
initiation of Gravity Probe B in 1988, $453 million has been spent on GP-B develop- 
ment. 

Although the completion of the GP-B program has been a schedule and cost 
struggle for some time, Stanford University has made significant progress in build- 
ing over 85 percent of the complex subsystems of GP-B. These subsystems are meet- 
ing or exceeding specifications required to conduct a creditable experiment to verify 
Einstein’s General Theory of Relativity. Stanford has considerable technical capa- 
bilities and a high degree of dedication. 

As a result of a recent functional test of GP-B’s Integrated Dewar & Probe, sig- 
nificant technical anomalies have surfaced, which required the de-integration of the 
payload as well as the implementation of design modifications. A re-integration and 
repeat of the functional testing to verify the effectiveness of the modification and 
to certify the flight worthiness of the payload will follow this activity. The complex 
nature of this integration process, which is unlike any payload ever built, coupled 
with the data readout sensitivity and precision requirements of the hardware, has 
resulted in a substantial schedule slip as well as the cost to complete the program. 

With the focus to resolve the current technical issues, NASA is aware that new 
issues could surface as a result of the changes being made. We are taking a number 
of steps to ensure that our design modification are sound and that all possible steps 
are taken to minimize future technical issues: 

• NASA has recently intensified the direct involvement of our existing External 
Independent Readiness Review (EIRR) team by asking them to work closely 
with Stanford and the Marshall Space Flight Center (MSFC) to review all as- 
pects of the program. This includes the proposed design modifications and daily 
feedback to the Stanford/MSFC design team on recommendations that promote 
schedule and cost control with the emphasis on mission success. The EIRR re- 
ports the status of the program regularly to NASA’s Associate Administrator for 
Space Science. 

• NASA established an Independent Review Team comprised of nationally recog- 
nized industry and Government experts in building complex space systems. This 
team was chartered to “conduct an assessment of the programmatic health 
(technical, schedule, management) of the Gravity Probe-B program” and provide 
immediate feedback to Stanford University, MSFC and NASA Headquarters on 
any modification to the design or flight qualification of the payload necessary 
to ensure mission success. The Independent Review Team completed its review 
and reported back to the Associate Administrator for Space Science in late Feb- 
ruary with the following conclusions: 

Schedule Risk Assessment: 

• poor prediction of progress on critical path; 

• high probability that electronic boxes (already more than a year behind sched- 
ule) will impact critical path during environmental testing; 

• probe repair is on critical path; and, 
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• additional funding needed to mitigate schedule. 

Cost Risk Assessment: 

• any schedule or technical issue could become a cost risk if not resolved quickly; 

• need to install NASA management at Stanford for quick decision making and 

to insulate Stanford from outside distractions; 

• refurbish Probe B as flight backup unit to mitigate potential payload recycle; 

and, 

• technical Risk Assessment: 

• Probe C neck temperature anomaly of most concern; root cause remains un- 
known. 

As a consequence of the testing problems, GP-B has been delayed at least 18 
months and is currently under consideration for an April 2002 launch. NASA’s esti- 
mated cost to address the technical problems and the schedule delays is $65-100 
million. As the Committee is aware, approximately $20 million of this increase has 
already been accommodated in NASA’s FY 1999 and FY 2000 Operating Plans and 
in the FY 2001 budget request. Analysis is underway to define impacts to the Space 
Science budget to fund the remainder. A Headquarters-controlled critical milestone 
schedule is also in development. 

During the late July timeframe, NASA expects to make a decision with respect 
to the future of the Gravity Probe B Program, based upon the extent to which 
progress is being made toward resolving the technical and schedule issues, and the 
extent to which remaining budget requirements will impact other Agency science 
priorities. 

X-33 Status 

The X-33 objective is to demonstrate technologies and operations concepts with 
the goal of reducing space transportation costs to one tenth of their current level. 
NASA is utilizing an innovative management strategy for the X-33 program, based 
on industry-led cooperative agreements, allowing a much leaner management struc- 
ture, lower program overhead costs, and increased management efficiency. The X- 
33 program Phase II selection was made in July 1996 based on specific pro- 
grammatic, business planning, and technical criteria. NASA selected the Lockheed 
Martin Skunk Works to lead an industry team to develop and flight test the X-33. 

The X-33 is an integrated technology effort to flight demonstrate key Single Stage 
To Orbit (SSTO) technologies, and deliver advancements in: 

1. ground and flight operations techniques that will substantially reduce oper- 
ations costs for a Reusable Launch Vehicle (RLV); 

2. lighter, reusable cryogenic tanks; 

3. lightweight, low-cost composite structures; 

4. advanced Thermal Protection Systems to reduce maintenance; 

5. propulsion and vehicle integration; and, 

6. application of New Millennium microelectronics for vastly improved reli- 
ability and vehicle health management. 

The X-33 Program deals with cutting-edge technologies, such as large composite 
tanks, a metallic thermal protection system, innovative aerospike engines, and a 
lifting body approach to a launch system. The program has made considerable 
progress in the last year. The X-33 launch complex was completed and site activa- 
tion begun. In addition, the structural testing of the liquid oxygen tank was success- 
fully completed; the flight software was delivered and verification and validation 
was undertaken; the linear aerospike engine was delivered to Stennis and testing 
begun; the metallic TPS was flight qualified; and the liquid hydrogen composite 
tank was delivered to MSFC for testing. Three cryogenic and structural load tests 
of the hydrogen tank, based upon 105 percent of maximum flight conditions, were 
completed. However, after the completion of the third test, a partial failure of the 
outer skin of one of the 4 lobes of the tank was observed. 

A failure investigation of the hydrogen tank, by a team of NASA and industry 
personnel, was initiated in November 1999. The failure investigation team will 
make a report on the root cause of the failure. Their report is expected to be re- 
leased within the coming weeks. After reviewing the team’s findings, NASA and the 
contractor will jointly agree on the approach necessary to recover from the hydrogen 
tank failure and then proceed with development of a recovery plan and schedule. 

In an effort as technologically challenging as the X-33 program, incidents like the 
tank failure — while disappointing — are not unexpected. Furthermore, it is important 



24 


to remember that, thanks largely to our commitment to safety and the various inde- 
pendent reviews we have carried out, the tank failure occurred in the test stand 
rather than in flight. 

As the X-33 program has evolved, our industry partners have been exceptional 
in accommodating such challenges. While industry’s investment has grown signifi- 
cantly since the beginning of the program, NASA’s financial investment in the X- 
33 has not increased. We have, however, utilized additional staff across the Centers 
to help resolve issues as they have arisen. As other challenges develop in the future, 
we will assist our industry partners to the extent that our program priorities per- 
mit. 


Attachment 1* 


MISSION SUCCESS FIRST 

Checklist for Project Management and Review Boards 
PEOPLE 


Leadership 

□ Is an accountable, responsible person in place and in charge with experience 
and training commensurate with the job? 

□ Does the leader work well with the team and external interfaces? 

□ Does the leader spend significant time fostering teamwork? 

□ Is safety the number-one priority? 

Organization/Staffing 

□ Is the organization sound? 

□ Is the staffing adequate? 

□ Are science and mission assurance elements properly represented in the orga- 
nization? 

□ Does the organization enable error-free communication? 

Communications 

□ Is “Mission Success First” clearly communicated throughout the organiza- 
tion? 

□ Is open communications evident, with all parties having an opportunity to be 
heard? 

□ Is a “Top 10” reviewed and acted upon weekly? 

□ Are all team members encouraged to report problems? 

□ Are line organization/project communications good? 

□ Do all team members understand that the only real success is mission success? 

Project Team 

□ Is safety the number-one priority? 

□ Has team chemistry been considered, and personality profiles reviewed? 

□ Is staffing adequate for project size, and are the right people in place? 

□ Are people who could not demonstrate teamwork gone? 

□ Are all key positions filled and committed to a sustained effort over the 
project’s life cycle? 

□ During team formation, has the project manager performed an Agency-wide 
search to identify key technical experts for membership on the team or sus- 
tained support to reviews? 

□ Is the team adequately staffed and trained in the processes? 

□ Are team members supportive and open with one another, review boards and 
management? 

□ Does the team actively encourage peer reviews? 

□ Are science representatives involved in day-to-day decision-making? 

□ Does the team understand that arrogance is their number-one enemy? Does 
the team understand that “anyone’s problem is my problem?” 

□ Does the team have assessment metrics, which are evaluated regularly? 

PROCESS & EXECUTION 


Systems Engineering 

□ Are risk trades included in the scope of the system engineering job? 


Prepared by the Mars Climate Orbiter Mishap Investigation Board 



25 


□ Have risk trades been performed and are risks being actively managed? 

□ Have flight/ground trades been performed? 

□ Is a fault tree(s) in place? 

□ Are adequate margins identified? 

□ Does mission architecture provide adequate data for failure investigation? 

□ Is “Mission Success First” reflected in the trades and systems efforts? 

□ Is there a formal process to incorporate lessons learned from other successful 
and failed missions? 

□ Has the team conducted reviews of NASA lessons-learned databases early in 
the project? 

□ Is a rigorous change control process in place? 

Requirements 

□ Was mission success criteria established at the start of the mission? 

□ Is “Mission Success First” reflected in top-level requirements? 

□ Are mission requirements established, agreed upon by all parties, and stable? 

□ Is the requirements level sufficiently detailed? 

□ Is the requirements flowdown complete? 

Validation and Verification 

□ Is the verification matrix complete? 

□ Are the processes sound? 

□ Are checks in place to ensure processes are being followed? 

□ Does every process have an owner? 

□ Is mission-critical software identified in both the flight and ground systems? 

□ Are processes developed for validation of system interfaces? 

□ Are facilities established for simulation, verification and validation? 

□ Is independent validation and verification planned for flight and ground soft- 
ware? 

□ Are plans and procedures in place for normal and contingency testing? 

□ Is time available for contingency testing and training? 

□ Are tests repeated after configuration changes? 

□ Are adequate end-to-end tests planned and completed? 

Cost/Schedule 

□ Is cost adequate to accommodate scope? 

□ Has a “bottoms up” budget and schedule been developed? 

□ Has the team taken ownership of cost and schedule? 

□ Are adequate cost reserves and schedule slack available to solve problems? 

□ Has mission success been compromised as a result of cost or schedule? 

Government/Contractor Roles and Responsibilities 

□ Are roles and responsibilities well defined? 

□ Are competent leaders in charge? 

Risk Management/Analysis/Test 

□ Is risk managed as one of four key project elements (cost, schedule, content 
and risk)? 

□ Are analysis measures in place (Failure Modes and Effects Analysis, Fault 
Tree Analysis, Probablistic Risk Assessment)? 

□ Have single-point failures been identified and justified? 

□ Has special attention been given to proper reuse of hardware and software? 

□ Has extensive testing been done in the flight configuration? 

□ Have potential failure scenarios been identified and modeled? 

□ Is there a culture that never stops looking for possible failure modes? 

Independent/Peer Review 

□ Are all reviews/boards defined and planned? 

□ Is the discipline in place to hold peer reviews with “the right” experts in at- 
tendance? 

□ Are peer review results reported to higher-level reviews? 

□ Are line organizations committed to providing the right people for sustained 
support of reviews? 

Operations 

□ Has contingency planning been validated and tested? 

□ Are all teams trained to execute contingency plans? 

□ Have mission rules been formulated? 

□ Has the ops team executed mission rules in simulations? 
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□ Are plans in place to ensure visibility and realtime telemetry during all critical 
mission phases? 

Center Infrastructure 

□ Is a plan in place to ensure senior management oversight of the project? 

□ Is a plan in place to ensure line organization commitment and accountability? 

□ Is a plan in place to mentor new and/or inexperienced managers? 

Documentation 

□ Have design decisions and limitations been documented and communicated? 

□ Is a process of continuous documentation in place to support unanticipated 
personnel changes? 

□ Is electronic/web-based documentation available? 

□ Are lessons-learned available and in use? 

Continuity/Handovers 

□ Are handovers planned? 

□ Are special plans in place to ensure a smooth transition? 

□ Do core people transition? Who? How many? 

□ Is a development-to-operations transition planned? 

□ Does development-team knowledge exist on the operations team? 

□ Is a transition from the integration-and-test ground system to new-operations 
ground system planned? If so, is there a plan and schedule to revalidate data- 
bases and procedures? 

□ Have there been changes in management or other key technical positions? 
How was continuity ensured? 

□ Have processes changed? If so, has the associated risk been evaluated? 

Mission Assurance 

□ Is staffing adequate? 

□ Are all phases of the mission staffed? 

□ Is mission assurance conducting high-level oversight to ensure that robust mis- 
sion success processes are in place? 

TECHNOLOGY 


Technology Readiness 

□ Is any new technology needed that has not matured adequately? 

□ Has all appropriate new technology been considered? 

□ Has it been scheduled to mature before project baselining? 

□ Does it represent low deployment risk? 

□ Is there a plan in place to train operations personnel on new technology use 
and limitations? 

Mr. Goldin. But, first, if it is OK with you, I would like to re- 
spond to the issue that you and Senator McCain brought up. First, 
with regards to the Young report, we recognized that more time 
would be necessary for NASA to review the report. 

We got our in-house briefing on March 14th. There is an appen- 
dix for the report we received electronically today by John Cassani. 
We will review that in detail. 

I have a meeting scheduled with Tom Young on Friday to clarify 
a number of the issues. And we expect to issue the report early 
next week. 

We made your staff aware about 3 weeks ago of this situation 
and said we would be prepared to have the hearing after the Young 
report was released, or to go ahead now, and then after the Young 
report is released, have another hearing. So this is the first point 
I would like to make. 

Senator Frist. And the Young report will be released when? 

Mr. Goldin. I think Tuesday next week. 

Senator Frist. All right. 

Mr. Goldin. Well, we will meet with him Friday. And then we 
will have it out Tuesday along with the appendix I referred to. 
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Senator Frist. Is it being altered now, the report, based on 
your 

Mr. Goldin. No. The report is not being changed itself. But we 
needed to get the final version of the supporting appendices, which 
is quite a thick report, so we could review it, and be prepared to 
ask questions to get clarification. But, we do not change those re- 
ports. That is very clear. 

Senator Frist. And is it appropriate for our Chairman to see that 
report at this juncture? 

Mr. Goldin. We were unaware that there was a request made. 
And I just asked my staff when that statement was made. We are 
unaware that there was any request made for that report. 

Senator Frist. OK. 

[Pause.] 

Mr. Goldin. Oh, I stand corrected. A request was made for the 
report and the NASA respondent said the report was not available 
yet, because we did not have all the appendices to that report. And 
that is what we received today. 

Senator Frist. So you have the appendices. Would you expect — 
well, you may not be able to answer — now, would you expect that 
our Chairman could — could see that report? 

[Pause.] 

Mr. Goldin. We are days away from making the report public. 

Senator Frist. OK. Proceed. 

Mr. Goldin. OK. Secondly, with regards to the UPI story, there 
was an allegation made incorrectly in the story about testing of the 
thrusters. We identified that problem in November. There was an 
open press conference on it, I believe, November 11th, where it was 
thoroughly discussed and the contractor was made aware of the 
problem, and we had time to do testing of that propulsion system 
before the scheduled landing of the Mars Polar Lander. 

There are a number of things that were very, very irregular in 
that press report. We have made our concerns known to UPI, and 
we believe we are doing all the right things. 

Senator Frist. Just — just for the record, the article is entitled, 
“NASA Knew Mars Polar Lander Doomed,” by UPI, United Press 
International, March 21st, 2000, by James Oberg, O-b-e-r-g, UPI 
Space Writer. 

Mr. Goldin. By the way, the press conference was November 
8th, and at that point in time the team believed they had a real 
good chance of doing it. In fact, the head of the investigation team 
of the Mars Climate Orbiter, Art Stephenson, had asked the pro- 
pulsion expert, a gentleman named Bob Sachiem to get involved. 

He identified that problem at that time and they requested addi- 
tional testing to get more confidence in that landing system. 

[Pause.] 

Senator Hutchison. So are you saying that you did — that NASA 
did not know there was a fatal flaw in the braking thrusters? 

Mr. Goldin. We knew about that in November, and we asked for 
an additional test 

Senator Hutchison. And the 

Mr. Goldin. — set of tests to make sure we — and they did those 
tests and they reset the conditions on the spacecraft, so we did not 
believe it would be a fatal flaw after the tests. 
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Senator Hutchison. You thought then it had been fixed? 

Mr. Goldin. Yes. 

Senator Frist. The — I do not — I do not want to belabor the press 
article, because I know we have so much to cover, but yesterday’s 
press article also mentioned your safety memo issued on March 
20th to NASA employees in which you stressed, and I quote, “the 
important of adequate testing.” 

Can you elaborate at all on that memo? 

Mr. Goldin. I would be honored to elaborate. As the NASA Ad- 
ministrator, I give a safety lecture on Mondays. My notes from the 
safety lectures are put on the Internet. I announced to my staff 
that I intend to talk about safety at our Monday morning phone 
call. And that is the subject I talk about. And each week, I pick 
another subject to talk about safety. That was one of the subjects 
I talked about. 

Senator Frist. And those comments there were not related to the 
Mars failures in that memo? 

Mr. Goldin. Those comments were related to a variety of cir- 
cumstances that I had expressed concern about, proper validation 
and testing. It is fundamental to good, sound engineering practice 
and as the head of the agency, I feel it is crucial that that is what 
I talk about. 

Senator Frist. Well, let us move on again. I do not want to — the 
UPI article, you have rebutted in part with a — with a press release 
today; and rather than go through it, we can come back to it if peo- 
ple have specific questions. 

Let me — was there anything else to respond to? 

Mr. Goldin. Mr. Chairman, I would like to add one more point 
to it. Most responsible reporters, if they feel they have a story, al- 
ways call and give the agency a chance to respond and rebut. We 
never received such a call. 

And I believe among the people in the Nation that work on these 
cutting edge approaches, I am at the cutting edge of safety. And 
I take it as an affront that I would actually worry about a failure 
and cover up a failure when I talk about safety. My record is open 
and clear and I have absolutely no regrets, no concerns and no 
apologies. 

Senator Frist. Mr. Goldin, there are a number of reports — and 
as you looked through the recommendations and suggestions, a 
common finding seems to be that employees — and you acknowledge 
this in your written statement — have not adhered to sound engi- 
neering and project management principles, agency standards and 
procedures. 

It — again this is from a number of the reports. How do you plan 
to correct these findings in the reports? 

Mr. Goldin. OK. Again, I would like to provide a little context 
before I answer that. We have had spectacular successes. The 
Mars, the Lunar Prospector, the Pathfinder Mission. 

We have had more than a dozen successful missions where exe- 
cution was outstanding. But let me give you an example of one of 
them. We are in the middle of unbelievable change. And the Jet 
Propulsion Lab, in particular, went from an average of four projects 
to fifteen to twenty projects. 
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So we had a new team coming on. Some teams executed well. 
And other teams did not execute. On the Pathfinder Mission, which 
successfully landed on Mars, it was a radical new management ap- 
proach, different. 

We had wise old owls come in to critique it. And they constantly 
said, “Impossible, this will not work. It is a disaster.” After we 
landed on Mars — but the people persevered in spite of the criticism, 
because they wanted to bring about change. They did a mission for 
one-tenth the cost of a prior mission. And they did it in 3 years in- 
stead of ten. 

Of course, we are going to make errors. But after that spacecraft 
landed on Mars in 1997, the person who criticized it walked up to 
me and said, “Dan, I have been openly criticizing this approach. 
And I want to take this opportunity to apologize. You took a risk. 
You did it right.” 

Now, did we have problems? Yes. And I think that due to the fact 
that we pushed real hard on budget, and I am personally respon- 
sible for that, we wanted to see where the boundaries were. 

It used to cost $600 million on average to build a spacecraft at 
NASA. And it used to take on average 8 years. And in 1992, we 
launched two scientific spacecraft. We now are launching more 
than ten. The average cost is $208 million and it takes 5 years. Did 
we push the limits? You bet. Did we push too fast? Absolutely. But 
we now are stepping back and saying, “Look, we found some prob- 
lems. We are going to understand it. But we are not returning to 
$600 million a spacecraft. We are not returning to 8 years on aver- 
age. And we are not returning to two launches a year.” 

I might also point out that we lost a spacecraft in 1992 called the 
Mars Observer. $800 million, and we had “proven techniques,” but 
they tried something different and they failed. We should not 
blame the people. 

Now, as a final point, we intend to take all these reports, Mr. 
Chairman, and we are going to have our chief engineer pull the key 
features together. And when we go through all these issues, within 
some months from now — we intend to come back to this Committee 
to tell you exactly what we think we need to do to fix these issues 
and we will hold education courses with every key NASA and con- 
tractor employee. We intend to set up a very major training pro- 
gram. 

In later testimony, in the Stephenson report, he calls out a 
checklist, which I put into the written testimony. That is going to 
serve as a starting point for where we want to go. 

And I believe that this will only strengthen our ability, but let 
me come back and say we had projected that in the 2000 to 2004 
timeframe we would drop from $208 million a space craft to $86 
million. 

I think we are going to have to re-look at that and see if we want 
to moderate that, because it is clear we have now hit the limits and 
we probably cut too tight. 

But this is a message to my associates in industry. 

Senator Frist. I want to move on to other questions. 

I guess, again, looking through the reports, when we say inad- 
equate adherence to sound engineering and project management 
principles, it goes beyond budget and doing things inexpensively, 



30 


because you are not going to be cutting management principles 
and — and sound engineering practices. 

And so to me, there are two issues. That is why I do want to stay 
on management during this hearing as much as possible. 

Mr. Goldin. OK. Good. 

Senator Frist. And — and you have — you have answered the 
question, what you plan, and to go through the checklist, and look 
to the future. 

Mr. Goldin. Right. 

Senator Frist. But, again, on each of these statements when 
these critiques are there, even though we have been tremendously 
successful, when we are talking about management, when we are 
talking about sound engineering practices, agency standards and 
procedures, somewhere it is not working. 

Mr. Goldin. I agree. We had just a few programs at NASA that 
lasted about a decade. There was tremendous stability in that. 
There was time to train people and bring them up the line. 

Now, suddenly, we have increased the number of programs by 
about a factor of four or five. We are bringing on a new staff that 
has never been in leadership positions. I believe the problem was 
in inadequate training and mentoring of those people. Some of 
them took to it naturally and did not have problems. But I would 
say the key error that was made in judgment in executive manage- 
ment was not setting up an adequate training and mentoring pro- 
gram, which has nothing to do with money. And I think that is the 
point that you were driving at. 

Senator Frist. Yes. Thank you. 

Senator Flutchison. 

Senator Hutchison. Thank you, Mr. Chairman. 

NASA has had to repeatedly fight for funding our existing 
human space flight commitments to complete the Space Station 
and upgrade the Shuttle. 

I have been on the station and I have seen the potential that we 
have for medical research and new technologies that can be avail- 
able from space research, but I — I wonder if there is a priority. 

If short exploratory missions to Mars are the best way to ad- 
vance NASA, should that be done at the expense of human space 
flight, research and development. Is there a priority that you see, 
or do you think we can do both with the — the limited budget that 
you have? 

Mr. Goldin. The No. 1 priority at NASA is fly the Shuttle safely. 
The No. 2 priority at NASA is successfully complete construction 
of the Space Station. 

The No. 3 priority at NASA is work with the industry in Amer- 
ica, and develop revolutionary new ways of making the reliability 
of access to space for people and payloads a factor of ten better and 
one-tenth the cost. 

The fourth priority at NASA is to do good science and technology 
and meet the expectations of the American people. It is in our stra- 
tegic plan. It is part of our budget process. And that is 

Senator Hutchison. You put in the good science 

Mr. Goldin. — where we put the priorities. 

Senator Hutchison. — and technology. Is the Mars exploration 
in that fourth category? 
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Mr. Goldin. Yes. 

Senator Hutchison. Last fall we heard testimony from NASA 
and the USA prime contractor about the Shuttle wiring matter. 
And at that time, NASA and USA testified that safety was put 
first, and that, in fact, USA knew they might get a $3 million pen- 
alty, but nevertheless, chose not to launch the next scheduled vehi- 
cle and inspect all the vehicles from that time forward. 

Is that consistent with the findings of the McDonald report, and 
are there any things that would be done differently today in inspec- 
tion of those vehicles that are because of the report? 

Mr. Goldin. Well, I think the report heightened our awareness, 
but what happened was exactly what I referred to in my opening 
statement. We want to encourage a culture at NASA where sched- 
ule is not the driving force, but the safety of the people and the 
high value assets is important. And that was correct. 

But the McDonald Committee pointed out some other issues. But 
I might point out that when we went through this wiring, they in- 
dicated that there was one area we needed to look at a little bit 
more, and it was a key finding. 

And, in fact, they said that we should do this before we launched 
the Shuttle, and that is, 70 percent of the wires were very, very 
visible and you could see where there could be abrasions, but about 
30 percent of the wires were inside areas that blocked the visual 
sight. 

So they recommended that we take the Shuttle Columbia which 
was in Palmdale, and since we were doing an orbital maintenance 
down-period on it, to open up areas that are invisible and see if we 
had any abrasion or any problems with the wires to validate that 
our assumptions were correct. And sure enough, when we opened 
up closed areas, we found almost no problem, so we were able to 
validate. And that’s why we felt comfortable successfully launching 
it. 

So, I think the McDonald panel pointed out something very, very 
important which caused us to think more and to delay a little bit 
more. It was a very valuable input. 

Senator Hutchison. Last year we provided $25 million in new 
upgrades that were directed at placing a higher priority on keeping 
the Shuttle fleet properly maintained. You have mentioned to me 
that in your fiscal year 2001 budget, there is funding for new Shut- 
tle upgrades. 

Which new upgrades have you funded with the additional $25 
million that was provided in last year’s appropriation, and what do 
you plan to fund with the $156 million contained in this year’s 
budget request, and are they all safety related? 

Mr. Goldin. First, let me answer the second question. They’re all 
safety related. And, in fact, the No. 1 priority on upgrades is to get 
rid of the hydrazine in the auxiliary power unit which was one of 
the major suggestions made by the McDonald Panel. They were 
very, very concerned about this equipment, and that $25 million 
from last year got us started on that. 

The second priority is intelligent vehicle health monitoring and 
management which is a revolutionary new technique of being able 
to diagnose perhaps incipient failures and take action before they 
occur. We then have a series of propulsion upgrades that we are 
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exploring to give the Shuttle a more robust capability. And one 
that is very high on the priority of the Aerospace Safety Advisory 
Panel, is to separate out critical operational functions from mission 
payload functions on the Shuttle and have a separation of those 
computers and a very advanced avionics system. And the upgrades 
that we are working on all relate to that, but we are not stopping 
there. We have asked the NASA Advisory Panel to take a look at 
these upgrades, and rate them, and establish that the No. 1 goal 
is safety, and that we have a set of cost objectives that are com- 
mensurate with what we are going forward to in terms of safety 
objectives. And they will be reviewing that over this year, but I am 
very pleased with what we are doing. And we have $2.1 billion in 
the 5-year budget run out which will get us there. 

Senator Hutchison. Let me just finish my last question, and 
that is the relationship with Russia. Many of the delays that have 
been caused have been because of Russian delays in doing their 
contractual obligations. 

Do you think this is in our best interest to continue the relation- 
ship with Russia, or would it be more efficient for us to absorb the 
added cost but be able to go it alone? 

Mr. Goldin. At this point in time, we have taken a number of 
steps, which in a way have led to some of the cost growth that Sen- 
ator McCain has raised. 

To be able to be more robust on the Station, we have an engine 
control module, a propulsion module, one of which will be ready in 
December this year, the other in 2003. We have made some very 
significant investments on our side to make it more robust. 

The Russians have finally completed the service module. They 
have had some launch failures, but they have now fixed the proton 
rocket. They have showed us things we would never show them 
about rocketry. And we just had a team come back from Russia in- 
dicating they believe that the Russians are on track. They have 
had two successful launches, but we want three more successful 
launches, two to three successful launches before we launch the 
service module. At this point in time, I believe we ought to proceed 
because we are almost done. 

Senator Hutchison. Thank you, Mr. Chairman. 

Senator Frist. Thank you. 

Senator Dorgan. 

Senator Dorgan. Mr. Chairman, thank you very much. 

Mr. Goldin, thank you for being here. In some ways, I sort of 
think as I hear you, and listen to you, that you invite your own 
critics because you are very assertive, and very positive. You have 
developed a new model, “Faster, Better, Cheaper.” You have turned 
that agency, in some ways, upside-down in the way it approached 
problems. 

You operate as an agency on the edge of technology and knowl- 
edge. Inherently, that is very risky, and all of us have always un- 
derstood that. 

Some critics have argued, Mr. Goldin, that “better” has, from 
time to time, been sacrificed to “faster and cheaper.” What is your 
response to that? 

Mr. Goldin. My response is: Sometimes they are right; some- 
times they are wrong. I contend that the Lunar Prospector, which 
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was built for $63 million, start to finish, was breathtaking, and if 
that is not better, and faster, and cheaper, nothing is. Pathfinder — 
we had the audacity to land on Mars with an air bag. 

When you go to the people that had done it before, and they said 
to us, “It is impossible,” we said, “We are not afraid.” Did we make 
mistakes? I think the key mistake was the one I identified, and I 
feel personal responsibility for that, but I am not apologetic. For 
the whole issue, we saw this huge surge coming forward, and we 
did not think to take the time to mentor and train the next genera- 
tion. 

We have the processes. We have the procedures. What we lacked 
was execution, so our performance was spotty. But, again, I want 
to point out, we need to focus on the failures, but we have had 10 
failures and 136 successes. It cannot be perfect, but we are going 
to learn and we are going to make it better. 

Senator Dorgan. We are not scientists or engineers. I mean, we 
have trouble parking in a two-car garage and want to criticize 
those that cannot land on Mars. So, I think all of us want the same 
thing. We want an agency that has the resources to do the job and 
to achieve the successes that all of us expect and want. 

Let me ask you a couple of more general questions. I understand 
the failures. I have read about them and tried to understand what 
has happened. I have read some of these reports. There are some 
people who are critical of some areas of management. 

Let me ask you about the successes just for a moment. In the 
past year — let us just take the past year — I have read about the 
failures in the past year. Can you tell us: What are your achieve- 
ments in the past year? What are the successes at NASA? 

Mr. Goldin. Well, let me bring up a few. Chandra: We have 
opened up a whole new window on the universe. The Hubble Space 
Telescope takes pictures in the visible the way we are accustomed 
to. We are looking at the dark energy, unbelievable energetic proc- 
esses. This is the most spectacular machine ever built. 

And in fact, the contractor was ready to ship it, and our leader, 
Ed Wallace, said, “We are not going to ship because it is not yet 
safe.” We launched that. It was a spectacular success, and is going 
to turn in science that is going to be breathtaking for the decade 
ahead. 

I have had Nobel laureates walk into my office and say, “This is 
an unbelievable machine. Thank you, NASA.” 

We fixed the Hubble Space Telescope, and I would like to clear 
up an issue that came up here. It was not an emergency servicing 
mission. What we did was we had the world’s best attitude control 
sensors on board, Gyros. We pushed the limits with those Gyros, 
and we did not know when they would fail. But we designed the 
system to be fixable by astronauts. 

When we lost the sensors, within 2 months of when we lost the 
sensors, we were up in space, and we were able to replace those 
sensors, replace payloads. And the Hubble Space Telescope re- 
solved an 8-year-old question, relative to what is called the Hubble 
constant: How fast is the universe expanding? This will rewrite 
chemistry and physics textbooks. 

So these are the kind of things we do. And my point is, we 
turned that mission around in record time by a factor of two. 
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Now the easy thing for the NASA Administrator to say is, “Hey, 
we may have a failure. We will be criticized. Let us play it safe.” 

I spoke to Joe Rothenberg, who is the head of the Office of Space 
Flight, and I said, “Joe, the scientists could be dark for as much 
as a year. Can you safely fix it in half the preparation time that 
we normally had?” He talked to his people and he said, “We are 
going to go.” And I said, “I will be personally responsible for that 
failure.” 

This is what you have got to do. And when you say that “I am 
afraid,” what you do is you set mediocre goals, and everyone is 
happy, and budgets go up. 

And I would like to show you one chart at this point. This is a 
chart that says it all. The bottom line there is the normalized 
NASA budget from 1993 to the year 2000. And it is going down. 

You see the defense budget there, and then you see the non-de- 
fense discretionary budget, and you see the total discretionary 
budget. Because NASA was determined that we were going to lis- 
ten to the American people about doing more with less, we said, 
“We are not afraid of failure. We are going to set the beat of the 
drum in this nation, and we are not going to accept mediocrity, and 
we are going to push the limits. And when we have failure, we will 
be responsible and accountable.” 

I salute every NASA employee, including those who failed, and 
not one employee is going to be fired. They have destroyed them- 
selves enough. I have got to tell you, they are down in the dumps, 
but we are going to recover. 

Senator Dorgan. Mr. Goldin, one additional question: The sec- 
ond panel that will follow you talks about a recurring theme of peo- 
ple at NASA. I mean, NASA is made up of people — scientists, engi- 
neers, administrators. 

Are you attracting the best young scientists and engineers to a 
career at NASA? What is your assessment of the talent that you 
are getting at NASA at this point? 

Mr. Goldin. First let me say, and I will accept responsibility for 
this, our work force has come down from about 25,000 to about 
18,500. We made a decision that we would have no forced layoffs 
in 1993 because we felt the people who were at the agency did not 
deserve to be fired to make a political statement. 

So we went by attrition. It has been painful. We have almost not 
hired for the last 7 years, but we respected the dignity of the work 
force. And now, we have the opportunity to hire 2,000 new people. 
We are at a real turning point. 

And is it going to be tough? You bet. We have to compete with 
dot-com companies. The President of one of the major technical 
universities said to me, “Dan, my smart kids are wanting to get eq- 
uity in the companies, and they are looking at compensation meas- 
ured in hundreds of thousands of dollars,” but none of these dot- 
com companies, none of these high-tech companies have what we 
have, the NASA vision, and the American dream. 

We are going to hire 2,000 people in the next few years. What 
we need to do is do a better job at mentoring. I am going to keep 
coming back to that. I feel terrible that I did not see it. 
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If we mentored properly, if we train properly, I do not think we 
would have seen the large variety of problems we have, and this 
is the area that is important. 

And there is one other key issue, Mr. Frist, and it just came to 
me. We did not have a good communications system. The problems 
were there, and the fact that people were speaking and we did not 
hear them, is another major failure that has nothing to do with 
cost, and nothing to do with schedule. So that is another significant 
area we have to fix. 

Senator Dorgan. If I might make, Mr. Chairman, one additional 
point. 

Mr. Goldin, you have been an agent of change and that by its na- 
ture, inherits substantial risk. All of us understand that. The 
Chairman, I think, made a point, and I think all of us on this panel 
would agree with the point. We need to learn from failure. We have 
had some failures. We must learn from that. The agency must 
learn. Congress must learn. 

You as an Administrator have indicated that you are learning 
lessons from those failures which are important to our future space 
program. 

Thank you for being here today. 

Mr. Goldin. Thank you for the comment. I am 59 years old, and 
I feel embarrassed. At this age, I am still learning, but we are com- 
mitted to do what is right for the country. 

And I spoke to the Chairman last night and I said, “I would wel- 
come a very vigorous hearing when we sort through all these 
issues.” We would like to work with this Committee in an open 
fashion to make sure you have confidence, and the American people 
have confidence that we are doing the right thing. 

Senator Frist. Senator Breaux. 

Senator Breaux. Thank you, Mr. Chairman, and thank you, Mr. 
Goldin for being with us, and for your presentation and response 
to the questions. 

It is a great deal of pride, I think, that all of us in the Congress 
can have, and this Committee in particular, because of our respon- 
sibilities for the job that NASA does in general. This is an area 
where the United States is clearly the best in the world, and who- 
ever is second is so far behind, that we can be justifiably proud. 

And of course, you will never make any mistakes if you never do 
anything. And sometimes we in the Congress follow that rule more 
often than we should, I think. 

You have had great successes, and when you have a failure, it 
is a big one. These things that you deal with 

Mr. Goldin. They are spectacular. 

Senator Breaux. They are spectacular failures, and they, unfor- 
tunately, get a great deal of the coverage. That is the way it is 
going to be, but I think we have to put it in balance. 

I think maybe some of my colleagues previously commented on 
the UPI story that was read, and I would like to ask you to com- 
ment on it. And I think that if this issue is left out there hanging, 
someone may read it and come to the conclusion that there are 
some real problems at NASA. 

I take it that the gist of the story was that on the Mars Polar 
Lander Project there were not one but two design flaws. It can be 
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expected every now and then that you would have things that were 
not designed properly. 

I think the disturbing thing in the story was that it implies that 
in the testing of the hydrazine part of the landing mechanism on 
the braking thrusters they did not get the right results, and that 
the tests and conditions were changed until they got the right re- 
sults. At least that is what I get out of reading the story. 

It would be very unfortunate if it occurred like that. Can you 
make any comments to clarify and give me some information on 
this? 

Mr. Goldin. I cannot remember the exact words, but it had to 
do with based on a whole bunch of rumors they heard, this was the 
case. Let me get the exact words because 

Senator Breaux. While you are looking for it, I just want to men- 
tion that the quote from the story is, “They tested the CAT bed ini- 
tiation process at temperatures much higher than it would be in 
flight.” The UPI source said, “This was done because when the 
CAT beds were first tested at the low temperatures predicted out 
to the long cruise from earth to Mars, the ignition failed, or was 
too unstable to be controlled. So the test conditions were changed 
in order to certify the engine’s performance. But the conditions 
then no longer represented those most likely to occur on the real 
space flight.” 

Can you comment on that? 

Mr. Goldin. I would be pleased. When we lost the Mars Climate 
Orbiter, it was a real shock to us. I asked Art Stephenson, who is 
the Director of the NASA Marshal Space Flight Center, to lead the 
review team. This man came to NASA from the private sector at 
great financial sacrifice because I asked him to do it just a year 
ago. He had been in the private sector his whole career. He was 
imminently qualified to lead a nationwide team to look at it. 

I said, “Do not just find out what was wrong with the Mars Cli- 
mate Orbiter, but we have a spacecraft called the Polar Lander 
that is on its way to Mars right now, and if there is anything we 
could learn from the Climate Orbiter, let us make sure we address 
it in the Polar Lander.” 

One of the members of his team pointed out that there was a 
problem with the propulsion system, or a suspected problem rel- 
ative to the operating temperature. 

Senator Breaux. But the Polar Lander had already been 
launched. 

Mr. Goldin. It was already launched, so what JPL and the con- 
tractor at Lockheed Martin did is run a whole series of tests to see 
if they could control the start temperature of that propulsion sys- 
tem. Based upon that, they changed the operating mode, so when 
they got to Mars, they verified from — before the thrusters fired, 
that we were at the right point. This to my recollection. This is 
what we know. 

And, in fact, in November when a press conference was held, No- 
vember 8th, we talked about this issue so there is no new news, 
no surprise, no nothing that I know about except there’s a state- 
ment here called, “Garbled Rumors.” 
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If anyone in America has any information indicating that there 
was some bad things, or inappropriate things done, if it is brought 
forward, we will investigate it. 

Senator Breaux. Would NASA not have had in that department 
a record of the tests that were made on the landing facility before 
they 

Mr. Goldin. Sure they do. 

Senator Breaux. Was it retested at different temperatures in 
order to get a different result? 

Mr. Goldin. You might want to ask Mr. Stephenson in the next 
panel the details of that, but I told you the process. And I like to 
make sure we are open, and what we have, we put on the web. We 
open up everything to everyone. So I believe we did everything we 
knew how to do. If there is something we did not do, if someone 
points it out, we will look into it. 

Senator Breaux. I guess failures are failures in the worst way 
when we do not learn from the failures. 

Can you tell us, in general, what you have learned from the fail- 
ures as far as making corrections in the process, or in any way that 
we have learned from the failures? 

Mr. Goldin. I think there are a couple of issues that are funda- 
mental that have nothing to do with money. And again, the Chair- 
man pointed this out. 

We changed the culture, and we were rapidly increasing the 
number of programs at the same time while a lot of veterans, the 
Apollo Air, and the cold war veterans of the space program were 
retiring, and we did not take the time to do adequate training, and 
adequate mentoring. And to do mentoring, you want to do on-the- 
job training. You want to give people real experience and follow 
along. 

I view that as the most critical error we made. The processes 
were in place. It was execution. The second one is the one I 
brought up just as you were walking in. I told Mr. Frist we did not 
have a good feedback system on communications. 

Some people actually believe that you rigidly had to stick to cost 
and schedule even though you saw problems coming. And the third 
lesson was we have terrific people. And I, as the leader of NASA, 
have to accept responsibility for those two very basic breakdowns. 

Senator Breaux. Well, I think that is encouraging to hear the 
Administrator, Mr. Chairman, say that, yes, there were mistakes 
made. You have learned from them, and you plan to correct them. 

I do not want to harp on the failures because the successes great- 
ly exceed the failures. Sometimes I get the feeling, as do other Sen- 
ators, that when our constituents come up and we have done nine 
out of ten things for them, the only thing they ask about is the one 
thing that we were not able to do. They forget about the nine 
things that we were successful in helping them get them get ac- 
complished — so we want to thank you for the good things that this 
agency has done and want to continue to work with you to make 
sure your good work continues. 

Mr. Goldin. Mr. Breaux, there is one thing that I left out that 
I just realized. Fundamental to the engineering and scientific proc- 
ess — and I left this out in my answer to the Chairman’s question — 
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is good strong peer review, not by your friends, but by people such 
as in the case of Pathfinder, who were really cynical. 

Some of our inexperienced managers did not understand this 
concept, and it comes back to training. And the other area that we 
have to very, very carefully look at, and I have asked our chief en- 
gineer to do that, is to really explore the process for how we select 
the peer review. 

We are not interested during peer review of hearing all the good 
things. And, in fact, this is my management strategy. Let us not 
concentrate on the 95 percent that we do right; let us focus on 
where we have problems. Let us magnify them, dissect them, un- 
derstand them, and fix them. 

We did not do an adequate peer review process on some pro- 
grams because of this inexperience factor. We are going to go back 
and make sure we fix that. 

Senator Breaux. Well, that is very encouraging. 

Thank you, Mr. Chairman. 

Senator Frist. Thank you, Senator Breaux. 

Mr. Goldin, just a couple of other quick points — and again, you 
have been very patient and I appreciate both your testimony and 
answers to the questions. I am glad that we evolved back to this 
work force because I think in looking at it from a management 
standpoint, it is an area that you recognize great deficiencies. 

And when you look at all these reports, and I am sure the Young 
Report will probably substantiate that as well, it does come back 
to this human aspect, work force. 

And I look down, since 1996, the Aerospace Safety Advisory 
Panel has cautioned NASA that the Shuttle program has experi- 
enced an erosion of critical skills, a lack of younger people at entry 
level positions, and a decreasing capacity to accommodate a higher 
Space Shuttle flight rate. 

In 1999, the panel recommended that NASA aggressively address 
work force problems to ensure safe operations. 

Jumping ahead to the next panel, the GAO testimony today cites 
NASA’s human exploration and development of space. Independent 
Assessment Office concluded that Kennedy Space Center had the 
minimum work force necessary to conduct daily business; “the min- 
imum” meaning, “And also reported that NASA had little evidence 
of structured training plans for its staff, and inadequate resources 
to support the needed training, which we have mentioned, but we 
have separated.” 

Your response, again, has been mentoring, communication, and 
then peer review. And I think those three are the responses that 
you have come to give us. And then at our next hearing, we can 
come back and look at those more aggressively. 

Is there anything else in this work force that you would like to 
add? 

Mr. Goldin. Yes, and that is the Aerospace Safety Advisory 
Panel, in their 1997 report, presented to me in February 1998, 
really felt strongly that we needed to take some action. And we 
commissioned what we call the Core Review Team, the Core Capa- 
bilities Review, that went very systematically through each area. 

Our people looked at stress indicators like: How many hours 
overtime is increasing? How many people are voluntarily giving up 
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vacation? How many people are going to the Employee Assistance 
Program for stress related problems? What is the health condition 
of the employees? 

And we went through center by center. We looked and found that 
we were really thin. So as part of the process, last year we author- 
ized the addition of people which is the fourth leg to the stool. 

The first things I said, and then you have to go out and hire peo- 
ple. The panel expressed to us a concern that the Shuttle needed 
experienced people, and when we brought fresh-outs, which are 
people who are fresh out of college with a Master’s, PhD, or a 
Bachelor’s degree, we put them on programs a little less critical 
than the Shuttle in Station. 

Give him his chance to train, put the experienced people on the 
Shuttle and the station, and then, as they learn, migrate them 
there. And that is exactly what we have done. 

And I just spoke to Roy Bridges, the Director of NASA Kennedy 
today, one of the primary concerns of the McDonald Panel, and you 
can address that issue to Dr. McDonald, was that we did not have 
enough quality inspectors at Cape Canaveral. We had to add 25. 
We have already hired those 25 people. And 12 of those people are 
on board, and by June, all 25 will be there. 

So, the fourth leg — it is the fourth leg of a stool. It is not sym- 
metric, and it will bounce a little bit, but the fourth leg of what 
we have to accomplish is go out to America, hire the best and 
brightest, and over the next 2 years, we have an ambitious goal of 
bringing in 2,000 people, but we will have the world’s best training 
program. 

And the last point I want to make to say we learned, we are 
working right now with MIT. We set up a new course on systems 
management, and we selected our top 20 people that are starting 
this pioneering course. 

So we are going to be working with a large number of univer- 
sities, so that we do not do just in-house training, but we will go 
for the best in America. So when we combine these four principals 
to the first order, we need more time to think. I think we will be 
on the road to recovery, and we will be even better. 

Senator Frist. Thank you. 

Let me just close with one last issue that has to do with the over- 
sight in this Committee. And what we have heard today, both the 
importance of it, and Chairman McCain’s comments earlier, that it 
really is our responsibility and our role that the $14 billion in tax- 
payer money is being managed in the very best way, and to iden- 
tify what deficiencies there are and where we need to work. 

As Chairman of this Subcommittee, last September, Senator 
McCain and I requested information from you, and from NASA, on 
the operational cost of the propulsion module which will add the 
additional capability to the Space Station. And that was Sep- 
tember, and I have the letter here, but from September 1999, and 
we still have not received a response. 

The importance of that request is not so much the challenge of 
whatever numbers are there, but it is to be a litmus test of wheth- 
er we should proceed with that program, whether or not to proceed. 

And the letter is just two paragraphs, and again, I just want to 
mention it, and I believe if you are not aware of it, your staff would 
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be. And the letter from me and Senator McCain to you basically 
says, “It was recently reported by the GAO that NASA has not de- 
veloped a cost estimate for the cost of operating the propulsion 
module for the International Space Station. As both Congress and 
NASA proceeds to make a final decision regarding this alternative 
propulsion and guidance in navigation capability, a better under- 
standing of the associated cost is essential,” and then we just make 
the request for the cost estimate. 

And again, it is not so much the particular numbers that I am 
interested in now, but it leads us to assume that your lack of a re- 
sponse means that the information is not available. 

And given things like the National Academy of Science’s recent 
finding of a lack of long-term planning on the station by NASA, the 
question comes back to us: Are we ready to proceed with propulsion 
module? 

Mr. Goldin. Let me say the following. I am very surprised you 
did not get a response, and I just asked Mai Peterson about that. 
We have had a recurring problem, and let me assure you in terms 
of oversight, we are going to fix that issue because communication 
must go back to you, and the Chairman of the big Committee. We 
will fix that. 

But we do have a very serious problem. Our contractor is a good 
contractor, but not outstanding. We made a commitment to trans- 
fer the things that NASA used to do in-house to our contractors, 
and we have a terrible time getting creditable cost proposals from 
our contractor. I think the reason you did not get a response is we 
did not have an answer to that question. So, this is something I 
will go back and look at. I can only say that right now from what 
I know and see, you have a right to be upset. 

Senator Frist. Thank you. Again, it is used as more of an illus- 
tration as we look at management, long-term planning, short-term 
planning, mid-term planning. If we cannot, or you cannot, both de- 
mand and receive that the information be shared with us, it will 
be impossible for us to give the adequate oversight expected by the 
taxpayers of America. 

Mr. Goldin. All I can say is, yes, we do have these problems. But 
in terms of long-term planning, NASA is one of the only agencies 
of organizations in the country that has a 25 year strategic plan. 
We do long-range planning. 

In some circumstances, we do not communicate all of the infor- 
mation that we have. So I will personally go back, look at it, and 
give you a formal response in detail instead of shooting from the 
hip which I just did. 

Senator Frist. No, and I understand, but the cost is a basic 
issue. 

Mr. Goldin. I understand. 

Senator Frist. What is this going to cost the American taxpayer? 
If we cannot answer it, and you cannot answer it, and your con- 
tractor cannot answer it, something is wrong, and we should not 
be going to the American people and saying, “You are paying for 
it though nobody can tell you how much this thing is going to cost.” 

Senator Breaux. Mr. Chairman 

Senator Frist. We need to move to the second panel. Senator 
Breaux. 
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Senator Breaux. Yes, just a quick question. I wanted to ask Mr. 
Goldin for his thoughts. 

Next week, I think that Senator Burns is planning on bringing 
legislation to the floor dealing with satellite television access for 
rural areas. 

I am thinking about adding to that legislation an amendment 
which would authorize, just authorize not fund, loan guarantees for 
space transportation for U.S. private companies to construct rock- 
ets in the U.S. to move into the satellite launch industry. 

You had testified on this issue before this Committee once before, 
and I do not want to characterize your position, but I took it to 
mean that you thought such legislation would be useful. It would 
be one of the tools that would be helpful. I wonder if you still have 
any current thoughts that you could update the Committee with 
this issue. 

Mr. Goldin. Yes, I think it is very, very innovative, what you 
had in mind. There has been a change since last year and that is 
the ability of small rocket companies to get commercial business 
just took a turn for the worse. 

Iridium, which put up 71 space craft, went bankrupt, and now 
they are going to literally de-orbit all those space craft. In addition 
to that, it has put a chill on the financing for other, what is called, 
low orbit mobile communications and Internet communication func- 
tions. We hope that this is cyclic and perhaps in 5 years there will 
be a recovery. 

Toward that end and the President’s budget, we have $4.5 billion 
to do cutting edge research, but not to do the production and devel- 
opment which your bill could enable. And it is our hope that by 
2005, we will have worked with small and big rocket companies to 
overcome all the critical barriers so we have technology that will 
allow us to improve the reliability ten times and cut their cost by 
a factor of ten. 

When that happens, hopefully by 2010, we will have private 
launch services not involving the government. This bill that you 
are looking at makes sense to me. However, I want to add some- 
thing and this is a message to my good friends in the space com- 
munity. They fight with each other, and they kill each other. 

You stepped forward with a good idea, and to prevent other rock- 
et companies from getting business, some good people did terribly 
stupid, vicious things. I ask every executive in the rocket business 
to take a deep breath, sit back, loosen your tie, and do not be afraid 
of competition, and do not try to kill a good bill that is being pre- 
sented to you. 

Thank you very much. 

Senator Breaux. I think I heard some breaths in the back of the 
room somewhere. 

Mr. Goldin. Oh, yes. I am winning more points again today. 

[Laughter.] 

Senator Breaux. Thank you very much. 

Senator Frist. Mr. Goldin, thank you for your testimony today 
and your forthrightness with the issues that were brought forward, 
and we look forward to working with you as we go ahead. 

Mr. Goldin. Thank you. 
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Senator Frist. At this juncture, I’ll ask the second panel to come 
forward. Our second panel will consist of four individuals: Mr. 
Allen Li, Associate Director of the General Accounting Office; Dr. 
Harry McDonald, Director, Ames Research Center; Mr. Tony Spear, 
former Mars Pathfinder Project Manager, from Jet Propulsion Lab- 
oratory, who is Task Leader, NASA’s Faster, Better, Cheaper Re- 
view Team; and, Mr. Art Stephenson, Director of the Marshal 
Space Flight Center. 

Let us proceed with our second panel. We will begin with Mr. Li, 
followed by Dr. McDonald, Mr. Spear, and Mr. Stephenson. 

Mr. Li, welcome. 

STATEMENT OF ALLEN LI, ASSOCIATE DIRECTOR, 

NATIONAL SECURITY AND INTERNATIONAL AFFAIRS, 

U.S. GENERAL ACCOUNTING OFFICE 

Mr. Li. Mr. Chairman and Members of the Subcommittee, I am 
pleased to be here today to discuss our ongoing work on the Shuttle 
program’s civil service work force. 

In the context of today’s hearing on management challenges, it 
is clear that NASA must, like other agencies, maximize its re- 
sources and accountability. In doing so, I believe NASA must focus 
on its most important asset: its people. I will now summarize the 
four points from my prepared statement. 

Point No. 1: Several studies point to the fact that the Shuttle 
work force has been negatively impacted by years of downsizing 
and buyouts. A common theme in these studies is that the work 
force has been stretched thin — to the point where there is just one 
qualified person in many critical areas. 

For example, NASA has identified 30 such critical areas at the 
Kennedy Space Center that do not have sufficient back-up cov- 
erage. In addition, studies have found that the work force is show- 
ing signs of overwork and fatigue. Also, not having enough people 
with the right skills impacts functions to be performed. 

One study expressed concern with NASA’s ability to perform 
mandatory Shuttle inspections. Initially, NASA believed that these 
inspections could be performed by the contractor. However, the 
agency later determined that a substantial number of inspections 
would still be needed to be performed in-house. 

Unfortunately by then, many of these inspectors had already left 
NASA. In reviewing these studies, there is one frequently identified 
aspect that I found worrisome, namely, that NASA employees were 
experiencing an increasing level of stress. 

This conclusion was based on multiple indicators such as in- 
creased forfeited of leave, absences from required training, and 
counseling visits through the employee assistance program. I defer 
to the Chairman as to the clinical significance of stress. But worker 
stress can result in problems in concentrating and difficulty in 
making decisions. 

While increased workload and stress from downsizing is likely to 
be found in many agencies and their units, their impact on main- 
taining a safe and efficient Shuttle program is unique. 

I have great respect for the hard work and dedication of all 
NASA employees, but I fear that their “can do” attitude may have 
masked some of the problems caused by downsizing. 
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Point No. 2: To its credit, NASA has responded to these work 
force problems in a number of ways. It has terminated its 
downsizing program and is increasing its budget to provide an ad- 
ditional 95 FTEs for the Shuttle program in fiscal year 2000. NASA 
has also increased its 2001 budget request to provide an additional 
278 FTEs for the Shuttle program. In addition, the Administration 
has directed the agency’s managers to consider ways to reduce 
workforce stress. 

The agency has included improved health monitoring as an objec- 
tive in its 2001 performance plan. 

Point No. 3. NASA faces a number of challenges in addressing 
the current Shuttle work force imbalance. These include accommo- 
dating increased training needs, attracting and retaining technical 
skills, dealing with uncertainties related to the future of Shuttle 
privatization and commercialization plans, and achieving a higher 
flight rate. 

Last year, NASA flew four Shuttle flights. If all goes well with 
the Space Station, the number of flights jumps to nine in 2001. Be- 
cause the Shuttle is now projected to be used at least through 
2012, safety upgrades are planned. A 5-year safety upgrade initia- 
tive will develop modifications to increase the safety of all major 
components of the Shuttle. According to Johnson Space Center offi- 
cials, the safety upgrade initiative will require up to 300 engineers. 

Point No. 4: The challenge of ensuring that NASA has the proper 
mix and number of staff to meet Shuttle objectives safely will re- 
quire a structured approach. Just hiring more engineers next year 
is not enough. The Comptroller general has recently brought con- 
certed attention to human capital issues in the federal government 
and the importance of long-term planning. 

The term human capital recognizes the fact that work force is 
the government’s greatest asset, whose value can be enhanced 
through investment. We believe that agencies must have a clear, 
fact-based understanding of its human capital situation. 

In this regard, we have provided a checklist for agency leaders 
to use to help them develop human capital strategies. This check- 
list allows them to scan their human capital systems to determine 
whether their approach supports their vision of who they are and 
what they want to accomplish, and to identify those policies that 
are in particular need of attention. 

The checklist helps to establish linkage between human capital 
programs and the agency’s mission, goals, and strategies. 

We have applied some of the concepts contained in the checklist 
during our review at NASA, and have provided copies of the check- 
list to agency personnel. We have been told that human resource 
officials are currently using the checklist as a guide in their work 
force planning and as part of the agency’s ongoing discussions with 
OMB. It is our hope that it will enable NASA to perform more com- 
prehensive evaluations of its human capital systems in the coming 
years. 

Thank you, sir. 

[The prepared statement of Mr. Li follows:] 
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Prepared Statement of Allen Li, Associate Director, National Security and 
International Affairs, U.S. General Accounting Office 

Mr. Chairman and Members of the Subcommittee: 

We are pleased to be here today to discuss our ongoing work on the National Aer- 
onautics and Space Administration’s (NASA) Space Shuttle program. We are cur- 
rently responding to the Committee’s request to review NASA’s plans for meeting 
current and future human capital needs. We plan to finalize our work and report 
on this issue in the coming months. As a result, my statement today presents our 
preliminary observations. 

NASA budget data shows that, since 1995, Shuttle workforce levels have de- 
creased from about 3,000 to about 1,800 full time equivalent employees. 1 NASA 
based its downsizing efforts on optimistic programmatic assumptions. For example, 
NASA believed it could reduce its workforce by consolidating contracts for flight, 
ground, and mission operations under a single private sector contract. In October 
1996, NASA awarded this contract. Under the contract, NASA was to provide incen- 
tives to eliminate unnecessary work and would no longer be involved in day-to-day 
Shuttle operations. However, because NASA was implementing a number of work- 
force reduction initiatives, NASA could not directly attribute specific reductions to 
the contract consolidation. Also, in 1994 NASA froze the Shuttle design in the ex- 
pectation that it would be replaced. NASA now expects to operate the Shuttle for 
at least the next decade. As a consequence, it initiated an upgrade program. In addi- 
tion, NASA’s downsizing coincided with a decreased number of Shuttle flights: eight 
flights in fiscal year 1997, but only four each in fiscal years 1998 and 1999. How- 
ever, the number of flights is projected to increase substantially as the International 
Space Station assembly schedule accelerates. NASA plans nine flights in fiscal year 
2001. NASA believes this will require more staff. 

Today we will focus on the Shuttle program’s civil service workforce. Specifically, 
we will (1) summarize the results of studies on the impact of workforce reductions, 
(2) describe NASA’s actions following these workforce assessments, (3) identify chal- 
lenges NASA faces in the anticipated heavy workload imposed by the International 
Space Station, and (4) suggest a structured approach NASA can take to analyze 
human capital challenges. 

RESULTS IN BRIEF 

Several studies, one as recent as March 2000, have reported that the Shuttle pro- 
gram’s workforce has been affected negatively by the downsizing, much of which has 
occurred since 1995. The studies concluded that the existing workforce is stretched 
thin to the point where there is just one qualified person in many critical areas. 
NASA has identified 30 critical areas at Kennedy Space Center that do not have 
sufficient backup coverage. These areas include Shuttle range safety systems and 
solid rocket booster and external tank electrical systems. In addition, the studies 
found that the workforce is showing signs of overwork and fatigue. For example, in- 
dicators including forfeited leave, absences from training courses, and stress-related 
employee assistance visits are all on the rise. Moreover, the program’s workforce age 
distribution and skill mix now limit opportunities for mentoring newer staff. For ex- 
ample, throughout the Office of Space Flight, which includes the Shuttle program, 
there are more than twice the number of workers over 60 years of age than under 
30 years of age. This jeopardizes the program’s ability to “hand off’ leadership roles 
to the next generation. 

NASA has responded to the workforce problems in a number of ways. It has ter- 
minated its downsizing program and is increasing its budget to provide an addi- 
tional 95 full time equivalent employees for the Shuttle program in fiscal year 2000. 
NASA has also increased its fiscal year 2001 budget request to provide an additional 
278 full time equivalent employees for the Shuttle program. In addition, the admin- 
istrator has directed the agency’s managers to consider ways to reduce workforce 
stress. 

NASA faces a number of challenges in addressing the current Shuttle workforce 
imbalance — especially given the anticipated increased workload. This includes ac- 
commodating increased training needs, ensuring adequate staffing levels for its safe- 
ty upgrade program, attracting and retaining technical skills, dealing with uncer- 
tainties related to the future of Shuttle privatization and commercialization plans, 
and achieving a higher projected flight rate. 


iFull time equivalent is a measure of staff hours equal to those of a full time employee work- 
ing 40 hours per week over the course of a year. 
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The challenge of ensuring NASA has the proper mix and number of staff to meet 
Shuttle objectives safely will require a structured approach. GAO’s internal control 
standards for the federal government discuss the importance of human capital man- 
agement in achieving program results. The Comptroller General has brought addi- 
tional attention to human capital issues and the importance of long-term planning. 
In this regard, we recently issued a checklist 2 for agency leaders to use, in order 
to help them develop human capital strategies. This checklist will allow agency 
managers “to quickly determine whether their approach to human capital supports 
their vision of who they are and what they want to accomplish, and to identify those 
. . . policies that are in particular need of attention.” The checklist follows a five- 
part framework, including strategic planning, organizational alignment, leadership, 
talent, and performance culture. The checklist helps to establish linkage between 
human capital programs and the agency’s mission, goals, and strategies. We have 
provided copies of the checklist to NASA. We believe NASA’s attention to human 
capital issues will be essential to ensuring the agency’s ability to achieve the goals 
of the Shuttle program. 

RECENT STUDIES HIGHLIGHT SHUTTLE WORKFORCE PROBLEMS 

Over the past several years, NASA and its Aerospace Safety Advisory Panel have 
studied the Shuttle program civil service workforce. 3 The studies concluded that the 
Shuttle program workforce has suffered significantly from the downsizing, much of 
which has occurred since 1995. For example, the studies conclude that the workforce 
may not be sufficient to support the planned Shuttle flight rate and many key posi- 
tions are not sufficiently staffed by qualified workers. In addition, the studies found 
that stress levels have reached the point of creating an unhealthy workforce. The 
results of these studies are highlighted below. 

• In its November 1999 report, NASA’s Human Exploration and Development of 
Space Independent Assessment Office concluded that, even with a relatively low 
flight rate, the Shuttle Processing Directorate at Kennedy Space Center had the 
“minimum” workforce necessary to conduct daily business. For example, the re- 
port expressed concerns with NASA’s ability to perform mandatory Shuttle in- 
spections. NASA believed that these inspections could be performed under its 
flight operations contract. However, after the departure of many inspectors, the 
agency determined that a substantial number of inspections would still need to 
be performed in-house. The report also found that NASA provided little evi- 
dence of structured training plans for its staff, and the resources to support 
needed training were inadequate. Given these concerns, the report concluded 
that NASA might not be able to support higher Shuttle flight rates projected 
in the future. 

• During the fall of 1999, NASA chartered a team to review the overall Shuttle 
systems and maintenance practices. The team, chaired by the Ames Research 
Center Director, assessed NASA’s standard practices in these areas and con- 
cluded that the current workforce was inadequate. In addressing human capital 
issues, the study noted that important technical areas were understaffed. For 
example, during a recent Shuttle wiring investigation, the team found that 
“workforce skill shortages created the need to use . . . personnel inexperienced 
in wiring issues to perform critical inspections.” In addition, the study team 
found that work stresses had impacted the downsized Shuttle workforce. For ex- 
ample, one center employee survey suggested that hypertension, gastro- 
intestinal, and cardiac conditions could have resulted from work-related stress. 

• In an internal study completed in June 1999, NASA concluded that the Office 
of Space Flight, which includes the Shuttle program, had (1) an inappropriate 
skill mix for current and future work, (2) a growing lack of younger staff to as- 
sume management and technical roles, and (3) an overworked and aging work- 
force. The study also concluded that there was an overall shortfall of workers. 
In response, NASA adjusted the agency’s workforce targets by providing one 
new hire for every two additional losses. 

• In the fall of 1999, NASA decided to build on its earlier workforce study to fur- 
ther define resource requirements. This second phase, completed in December 


2 Human Capital: A Self-Assessment Checklist for Agency Leaders, Discussion Draft (GAO/ 
GGD— 99-179, September 1999). 

3 Independent Assessment of the Shuttle Processing Directorate Engineering and Management 
Processes, NASA’s Human Exploration and Development of Space Independent Assessment Of- 
fice (November 4, 1999); Report to Associate Administrator, Office of Space Flight, Space Shuttle 
Independent Assessment Team (March 7, 2000); and Annual Report for 1999, Aerospace Safety 
Advisory Panel (February 2000). 
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1999, included an evaluation of stress-related issues. In terms of resources the 
study found that a “revitalization” of the workforce was required to prevent 
“significant” safety concerns. For example, at the Kennedy Space Center, the 
Shuttle program has only one qualified person in 30 4 critical systems areas. 
These areas include Shuttle range safety systems and solid rocket booster and 
external tank electrical systems. In addition, the study found that, throughout 
the Office of Space Flight, there were more than twice the number of workers 
over 60 years of age than under 30 years of age. This represented a reversal 
of the age profile just 6 years ago, creating a potential problem in developing 
future qualified leaders. 

• As for health issues, the study concluded that the agency was experiencing an 
“unhealthy” and increasing level of stress. This conclusion was based on mul- 
tiple indicators including increased forfeited leave, absences from required 
training, increased payment of overtime, and counseling visits through the em- 
ployee assistance program. This level of worker stress resulted in (1) problems 
in concentrating, (2) difficulty in making decisions, (3) inability to cope, (4) in- 
somnia, and (5) anxiety. 

• Perhaps the most persistent voice stressing the consequences of Shuttle work- 
force downsizing has been NASA’s Aerospace Safety Advisory Panel. This Panel 
is an independent group of experts consisting of nine members appointed by the 
NASA Administrator. Since 1996, the Panel has examined the potential safety 
impacts of downsizing and has consistently cautioned that the program has 
been experiencing an erosion of critical skills, a lack of younger people at entry- 
level positions, insufficient training opportunities, and a decreasing capacity to 
accommodate higher Space Shuttle flight rates for sustained periods. In its 1999 
annual report, the Panel recommended that NASA “. . . address its workforce 
problems aggressively” to ensure safe operations. It added that “emphasis 
should be placed on eliminating critical skills shortfalls and recruiting younger 
[engineers] who can develop into experienced and skilled future leaders.” 

NASA IS BEGINNING TO ADDRESS WORKFORCE PROBLEMS 

In response to the workforce studies, NASA is now implementing actions to ad- 
dress its workforce problems. For example, the agency has terminated its 
downsizing plans and expects to add 95 full time equivalent employees to the Shut- 
tle program in fiscal year 2000 to address critical skill shortages. In addition, in its 
fiscal year 2001 budget request, NASA is seeking authority to add another 278 full 
time equivalent employees to the Shuttle workforce. 

In addition to these immediate actions, NASA’s Administrator has announced that 
the agency will soon begin a joint review with the Office of Management and Budget 
to identify NASA’s overall future workforce needs. According to the Administrator, 
this review will assess potential tools and approaches for overall personnel manage- 
ment for the agency. 

NASA believes the stress-related indicators that were reported in the December 
1999 workforce study were critical evidence supporting the need for increasing 
NASA’s workforce. In October 1999, NASA’s Administrator directed the agency’s 
highest level managers to consider ways to reduce workplace stress. NASA subse- 
quently included improved health monitoring as an objective in its fiscal year 2001 
performance plan. 5 According to the plan, NASA plans to develop and implement 
supervisor-specific and individual training to identify, manage, and cope with stress 
in the workplace. 

NASA WILL CONTINUE TO FACE HUMAN CAPITAL CHALLENGES 

In dealing with its workforce problems, the Shuttle program will have to deal 
with a number of complicating factors. These include accommodating increased 
training needs, ensuring adequate staffing levels for its safety upgrade program, at- 
tracting and retaining employees with critical skills, dealing with uncertainties re- 
lated to the future of Shuttle privatization and commercialization plans, and achiev- 
ing a higher projected flight rate. 

For example, according to one NASA study, it could take 2 or more years to fully 
train new engineers, while the current Shuttle workload leaves little time for train- 
ing. Also, the Shuttle program has just begun a 5-year safety upgrade initiative. 
This initiative involves developing modifications to increase the safety of all major 
components of the Shuttle vehicle. According to Johnson Space Center officials, this 


4 This study identified a total of 87 critical systems areas at Kennedy Space Center. 

5 The Government Performance and Results Act of 1993 requires agencies to prepare annual 
performance plans. 
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initiative will require up to three hundred engineers. Moreover, some critically need- 
ed skills, such as software engineering will be hard to attract and retain. In August 
1999, we reported on this concern as it related to the Space Station program. 6 

In recent years, NASA has considered ways to maximize private sector involve- 
ment in Shuttle operations, including transitioning management functions and mar- 
keting of payloads for commercial applications. 7 Regarding the future Shuttle pri- 
vatization and commercialization plans, the Human Exploration and Development 
of Space Independent Assessment Office study noted that strategic planning, work- 
force deployment, and prioritization will be difficult. The study concluded that 
NASA “must begin to analyze how its workforce will evolve in the [new] environ- 
ments and prepare a plan for this evolution.” All of these challenges will have to 
be faced while the program attempts to double its current flight rate. In recent 
years, NASA has flown four flights a year, but plans to fly nine times in fiscal year 
2001, primarily to support the International Space Station assembly. 

STRUCTURED APPROACH FOR MEETING HUMAN CAPITAL CHALLENGES 
IS NECESSARY 

We believe NASA must build on its renewed emphasis on a healthy, diverse, and 
properly deployed Shuttle workforce. Our Standards for Internal Control in the Fed- 
eral Government, as updated in November 1999, address these workforce issues. 
The standards state that “only when the right personnel for the job are on board 
and are provided the right training, tools, structure, incentives, and responsibilities 
is operational success possible.” 

GAO’s Comptroller General has made improved human capital management 
throughout the federal government one of his top priorities. In testimony 8 on March 
9, 2000, he stated that “. . . human capital management recognizes that employees 
are a critical asset for success, and that an organization’s human capital policies 
and practices must be designed, implemented, and assessed by the standard of how 
well they support the organization’s mission and goals.” He also noted that we had 
recently published a human capital self-assessment checklist that provides a struc- 
tured approach to identifying and addressing human capital issues. This checklist 
will allow agency managers “to quickly determine whether their approach to human 
capital supports their vision of who they are and what they want to accomplish, and 
to identify those. ..policies that are in particular need of attention.” The checklist fol- 
lows a five-part framework, including strategic planning, organizational alignment, 
leadership, talent, and performance culture. It also provides a linkage of human 
capital programs to the agency’s mission, goals, and strategies. 

We have applied some of the concepts contained in the checklist during our work- 
force review at NASA and have provided copies of the checklist to NASA. We have 
been told that human resource officials are currently using the checklist as a guide 
in their workforce planning and the agency’s ongoing discussions with the Office of 
Management and Budget. It is our hope that it will enable NASA and other agen- 
cies to perform more comprehensive evaluations of their human capital systems in 
the coming years. 

Mr. Chairman, this concludes our formal statement. We would be happy to an- 
swer any questions that you or members of the Subcommittee may have. 

Senator Frist. Thank you. 

Dr. McDonald. 


6 Space Station: Russian Commitment and Cost Control Problems (GAO/NSIAD-99-175, Au- 
gust 17, 1999). 

7 In the past, the Shuttle program has performed commercial activities for which it has been 
reimbursed by the private sector. However, it has been limited from flying reimbursable pay- 
loads by federal regulations. NASA is in the process of reviewing these restrictive policies with 
their initiators with the objective of removing them as obstacles to a fully commercialized Shut- 
tle program. 

8 Testimony was given before the Subcommittee on Oversight of Government Management, 
Restructuring, and the District of Columbia, Senate Committee on Governmental Affairs (GAO/ 
T-GGD-00-77). Also on March 9, 2000, GAO testified on similar human capital concerns related 
to the Department of Defense. This testimony was given at a joint hearing involving the Sub- 
committee on Military Readiness, House Committee on Armed Services, and the Subcommittee 
on Civil Service, House Committee on Government Reform (GAO/T-GGD/NSIAD-00-120). 
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STATEMENT OF DR. HARRY MCDONALD, DIRECTOR, 

AMES RESEARCH CENTER, NATIONAL AERONAUTICS AND 

SPACE ADMINISTRATION, MOFFETT FIELD, CALIFORNIA 

Dr. McDonald. Thank you, Mr. Chairman, and thank you for 
the invitation to come here this afternoon. It is a pleasure and a 
privilege. 

The Shuttle program is one of the most complex engineering 
tasks undertaken anywhere in the world at the present time, and 
the Space Shuttle independent assessment team was chartered in 
September 1999 by the Associate Administrator for Human Space 
Flight, Mr. Joe Rothenberg, in light of several, in his mind, dis- 
turbing maintenance issues reflected in in-flight anomalies, i.e., 
problems encountered in the flight of the Space Shuttle mission. 

Mr. Rothenberg invited me to form a team comprised of both 
NASA and a contractor, together with DOD experts in the area of 
aircraft maintenance, wiring, and other technologies required in 
the maintenance of the vehicle. 

In performing this review, I would like to say at the outset that 
a very positive nature was observed in doing the review, not the 
least of which was the commitment, dedication, and outstanding 
skill of our work force, the NASA work force involved in maintain- 
ing the vehicle, including the very great concern for the safety of 
the astronauts. So that was really moving to see that commitment 
on behalf of the technician work force, in particular. 

It is very unfortunate that the nature of the type of review that 
we performed, that we were not able to dwell on that very positive 
aspect. We were there for the critical elements of the program. In 
this we noted that in the last few years, since 1995, there had been 
a massive change in the operation of the Shuttle. It had been 
transferred to a space flight operations contract. 

There had been significant slimming down of both the NASA and 
the contractor work force involved in supporting the Shuttle, in 
particular, from the maintenance point of view. All this had been 
accomplished without significant problems, and, indeed, with a 
very considerable cost saving to the agency. 

However, the assessment team did identify some problem areas, 
some significant problem areas that we felt should be addressed to 
maintain a safe and effective program. Some specifics are given in 
the body of the report, and I would just like to touch on a couple 
of them here. 

The assessment team was asked by the Space Shuttle Program 
Office for its views on the return to flight in December of last year, 
which occurred during the period of time in which we were under- 
taking the review, and we had concluded that a suitable criteria for 
the return to flight would be that the vehicle would then possess 
less risk than, for example, the STS-93, whereby two anomalies 
had occurred, one, the wiring short, the other is the pin injection. 
It was clear at that point in time, in December 1999, that that 
would be the case. 

There had been extensive reviews, extensive repairs, and many 
of the questions that we had raised had been answered, so that we 
were quite comfortable with the return to flight and the continued 
operation of the Shuttle. 
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We were pleased to learn that following the STS-103 flight that 
only minor in-flight anomalies had been encountered in that flight, 
which continued a downward reduction in the number of in-flight 
anomalies that had been occurring over the last six or 7 years. 

However, one of the continuing and major concerns among the 
assessment team members was the concern with the reduction in 
allocated resources, including appropriate staff required to ensure 
that the critical processes were being adequately and rigorously im- 
plemented, and continuously improved. 

Our findings showed to us, at least, that there were important 
technical areas that were undermanned, staffed one-deep, and this 
type of vehicle, given its severe environment in which it operated 
would require extensive maintenance, major amounts of touch 
labor, where actually technicians would replace and go on board 
the vehicle, and also it required a high degree of skill, a high de- 
gree of expertise, and significant on-the-job training. Touch labor, 
in particular, always creates the opportunity for collateral damage, 
and that was our belief that it occurred with the wiring issue. 

The technicians looking to repair other components on the vehi- 
cle, repair, or renew, maintain, would inadvertently damage the 
wiring by stretching, touching, standing, whatever, so that this em- 
phasized the need at the present time, given the present level of 
technology, for increased inspection and attention to these par- 
ticular areas. 

In addition, we observed that the program was using an increase 
in the standard repair designation and the use of fair wear-and- 
tear allowances, essentially hid the extent of some of these prob- 
lems from the management. 

They were not reported into the problem reporting and corrective 
action data base that would allow management to see that there 
were very significant numbers of repairs being done on, for exam- 
ple, the wiring. So we were a little concerned about that. 

We were also concerned that there is an operational philosophy 
within the program to only fly what you test, and test what you 
fly. Clearly, for various reasons, this had not been adhered to with 
regard to the pin problem. That was an example that came up. 

There was also the issue, and we believe that the Shuttle up- 
grades program will present us with the opportunity to correct a 
number of the observed efficiencies, in particular it might enable 
us to reduce the 76 areas where redundancy is compromised on the 
vehicle, and incorporate design for maintainability. 

So follow-on, we believe, activity is required to examine some of 
the other systems that we have not been able to examine in the 
light of our limited amount of time. We concentrated on the orbiter 
vehicle, and we believe that a similar type of review should be car- 
ried out in terms of the solid rocket motors and the external fuel 
tank, for instance, and that this follow-on activity should review 
our recommendations for implementation. 

In conclusion, shortly before delivering the part to NASA, the 
team was very gratified to learn that a number of steps had al- 
ready been taken by the agency to rectify some of the problems, 
some of the adverse findings that we had reported on. 

It was particularly pleasing to know that the targeted staffing 
additions which had been authorized and were referred to earlier 
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this afternoon by the Administrator, targeted staffing increases 
were directly mainly at quality assurance function, which we felt 
would be particularly beneficial to the program. With that, that is 
the end of my statement. 

[The prepared statement of Dr. McDonald follows:] 

Prepared Statement of Dr. Harry McDonald, Director, AMES Research 
Center, National Aeronautics and Space Administration, 
Moffett Field, California 

Space Shuttle Independent Assessment Team 

Report to the Associate Administrator 
Office of Space Flight 
October-December 1999 

Executive Summary 

The Shuttle program is one of the most complex engineering activities undertaken 
anywhere in the world at the present time. The Space Shuttle Independent Assess- 
ment Team (SIAT) was chartered in September 1999 by NASA to provide an inde- 
pendent review of the Space Shuttle sub-systems and maintenance practices. During 
the period from October through December 1999, the team led by Dr. McDonald and 
comprised of NASA, contractor, and DOD experts reviewed NASA practices, Space 
Shuttle anomalies, as well as civilian and military aerospace experience. 

In performing the review, much of a very positive nature was observed by the 
SIAT, not the least of which was the skill and dedication of the workforce. It is in 
the unfortunate nature of this type of review that the very positive elements are 
either not mentioned or dwelt upon. This very complex program has undergone a 
massive change in structure in the last few years with the transition to a slimmed 
down, contractor-run operation, the Shuttle Flight Operations Contract (SFOC). 
This has been accomplished with significant cost savings and without a major inci- 
dent. This report has identified significant problems that must be addressed to 
maintain an effective program. These problems are described in each of the Issues, 
Findings or Observations summarized below, and unless noted, appear to be sys- 
temic in nature and not confined to any one Shuttle sub-system or element. Spe- 
cifics are given in the body of the report, along with recommendations to improve 
the present systems. 

Issue 1 

NASA must support the Space Shuttle Program with the resources and 
staffing necessary to prevent the erosion of flight-safety critical processes. 

Human rated space transportation implies significant inherent risk. Over the 
course of the Shuttle Program, now nearing its 20th year, processes, procedures and 
training have continuously been improved and implemented to make the system 
safer. The SIAT has a major concern, reflected in nearly all of the subsequent 
“Issues”, that this critical feature of the Shuttle Program is being eroded. Although 
the reasons for this erosion are varied, it appears to the SIAT that a major common 
factor among them is the reduction in allocated resources and appropriate staff that 
ensure these critical processes and procedures are being rigorously implemented and 
continually improved. The SIAT feels strongly that workforce augmentation must be 
realized principally with NASA personnel rather than with contract personnel. The 
findings show that there are important technical areas that are staffed “one-deep”. 
The SSP should assess not only the quantity of personnel needed to maintain and 
operate the Shuttle at anticipated future flight rates, but also the quality of the 
workforce required in terms of experience and special skills. In the recent fleet wir- 
ing investigation, work force skill shortages created the need to use Quality Assur- 
ance personnel inexperienced in wiring issues to perform critical inspections. Note 
that increasing the work force carries risk with it until the added work force ac- 
quires the necessary experience. 

Issue 2 

The past success of the Shuttle program does not preclude the existence of 
problems in processes and procedures that could be significantly improved. 

The SIAT believes that another factor in the erosion referred to in Issue 1 is suc- 
cess-engendered safety optimism. The SIAT noted several examples of what could 
be termed an inappropriate level of comfort with certain apparently successful “ac- 
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ceptance of risk” decisions made by the program. One example was the number of 
flights with pinned liquid oxygen injectors flown without prior hot-fire testing that 
did not experience pin ejection before the STS-93 pin ejection rupture incident. 
These successful flights created a false sense of security that pinning an injector 
could be treated as a standard repair. There were 19 incidences of pin ejection that 
did not result in nozzle rupture prior to STS-93 and this created an environment 
that led to the acceptance of risk. Similarly the wire damage that led to the short 
on STS-93 is suspected to have been caused 4 to 5 years prior to the flight. The 
SSP must rigorously guard against the tendency to accept risk solely because of 
prior success. 

Issue 3 

The SSP’s risk management strategy and methods must be commensurate 
with the ‘one strike and you are out’ environment of Shuttle operations. 

While the Shuttle has a very extensive Risk Management process, the SIAT was 
very concerned with what it perceived as Risk Management process erosion created 
by the desire to reduce costs. This is inappropriate in an area that the SIAT believes 
should be under continuous examination for improvement in effectiveness with cost 
reduction being secondary. Specific SIAT findings address concerns such as: moving 
from NASA oversight to insight; increasing implementation of self-inspection; reduc- 
ing Safety and Mission Assurance functions and personnel; managing risk by rely- 
ing on system redundancy and abort modes; and the use of only rudimentary 
trending and qualitative risk assessment techniques. It seemed clear to the SIAT 
that oversight processes of considerable value, including Safety and Mission Assur- 
ance, and Quality Assurance, have been diluted or removed from the program. The 
SIAT feels strongly that NASA Safety and Mission Assurance should be restored to 
the process in its previous role of an independent oversight body, and not be simply 
a “safety auditor.” The SIAT also believes that the Aerospace Safety Advisory Panel 
membership should turnover more frequently to ensure an independent perspective. 
Technologies of significant potential use for enhancing Shuttle safety are rapidly ad- 
vancing and require expert representation on the Aerospace Safety Advisory Panel. 
While system redundancy is a very sound element of the program, it should not be 
relied upon as a primary risk management strategy; more consideration should be 
given to risk understanding, minimization and avoidance. It was noted by the SIAT 
that as a result of choices made during the original design, system redundancy had 
been compromised in 76 regions of the Orbiter (300+ different circuits, including 6 
regions in which if wiring integrity was lost in the region, all three main engines 
would shut down). These were design choices made based on the technology and risk 
acceptance at that time. Some of these losses of redundancy may be unavoidable; 
others may not be. In either case, the program must thoroughly understand how 
loss of system redundancy impacts vehicle safety. 

Issue 4 

SSP maintenance and operations must recognize that the Shuttle is not an 
‘operational’ vehicle in the usual meaning of the term. 

Most aircraft are described as being “operational” after a very extensive flight test 
program involving hundreds of flights. The Space Shuttle fleet has only now 
achieved one hundred flights and clearly cannot be thought of as being “operational” 
in the usual sense. Extensive maintenance, major amounts of “touch labor” and a 
high degree of skill and expertise by significant numbers of technician and engineer- 
ing staff will be always required to support Shuttle operations. Touch labor always 
creates a potential for collateral and inadvertent damage. In spite of the clear man- 
date from NASA that neither schedule nor cost should ever be allowed to com- 
promise safety, the workforce has received a conflicting message due to the empha- 
sis on achieving cost and staff reductions, and the pressures placed on increasing 
scheduled flights as a result of the Space Station. Findings of concern to the SIAT 
include: the increase in standard repairs and fair wear and tear allowances; the use 
of technician and engineering “pools” rather than specialties; a potential compla- 
cency in problem reporting and investigation; and the move toward structural repair 
manuals as used in the airline industry that allow technicians to decide and imple- 
ment repairs without engineering oversight. The latter practice has been implicated 
in a number of incidents that have occurred outside of NASA (Managing the Risks 
of Organizational Accidents, Chapter 2, p. 21). When taken together these strategies 
have allowed a significant reduction in the workforce directly involved in Shuttle 
maintenance. When viewed as an experimental / developmental vehicle with a “one 
strike and you are out” philosophy, the actions above seem ill advised. 
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Issue 5 

The SSP should adhere to a ‘fly what you test / test what you fly’ method- 
ology. 

While the “fly what you test / test what you fly” methodology was adopted by the 
Shuttle Program as a general operational philosophy, this issue arose specifically 
with the Space Shuttle Main Engine (SSME). For the SSME, fleet leader and hot- 
fire (green-run) testing are used very effectively to manage risk. However, the con- 
cept must be rigorously adhered to. Recent experience, for instance the pin ejection 
problem, has shown a breakdown of the process. An excellent concept, the fleet lead- 
er is also applicable to other systems, but its limitations must be clearly understood. 
In some cases (e.g., hydraulic testing, avionics, Auxiliary Power Unit) the SIAT be- 
lieves that the testing is not sufficiently realistic to estimate safe life. 

Issue 6 

The SSP should systematically evaluate and eliminate all potential human 
single point failures. 

In the past, the Shuttle Program had a very extensive Quality Assurance pro- 
gram. The reduction of the quality assurance activity (“second set of eyes”) and of 
the Safety & Mission Assurance function (“independent, selective third set of eyes”) 
increases the risk of human single point failures. The widespread elimination of 
Government Mandatory Inspection Points, even though the reductions were made 
predominantly when redundant inspections or tests existed, removed a layer of de- 
fense against maintenance errors. Human errors in judgment and in complying with 
reporting requirements (e.g., in or out of family) and procedures (e.g., identification 
of criticality level) can allow problems to go undetected, unreported or reported 
without sufficient accuracy and emphasis, with obvious attendant risk. Procedures 
and processes that rely predominantly on qualitative judgements should be rede- 
signed to utilize quantitative measures wherever possible. The SIAT believes that 
NASA staff (including engineering staff) should be restored into the system for an 
independent assessment and correction of all potential single point failures (see also 
the concerns concerning the Safety and Mission Assurance function in Issue 3). 

Issue 7 

The SSP should work to minimize the turbulence in the work environment 
and its effects on the workforce. 

Findings support the view that the significant number of changes experienced by 
the Shuttle Program in recent years have adversely affected workforce morale or di- 
verted workforce attention. These include the change to Space Flight Operations 
Contract, the reduction in staffing levels to meet Zero Based Review requirements, 
attrition through retirement, and numerous re-organizations. Ongoing turbulence 
from cyclically heavy workloads and continuous improvement initiatives (however 
beneficial) were also observed to stress the workforce. While the high level work- 
force performance required by the Shuttle program has always created some level 
of workforce stress, the workforce perception is that this has increased significantly 
in the last few years. Specifically, the physical strain measured in the Marshall 
Space Flight Center workforce significantly exceeded the national norm, whereas 
the job stress components (e.g., responsibility levels, physical environment) were 
near normal levels. This typically indicates the workforce is internalizing chronic in- 
stability in the workplace. Similarly, feedback from small focus groups at Kennedy 
Space Center indicates unfavorable views of communication and other factors of the 
work environment. Clearly, from a health perspective, one would seek to reduce em- 
ployee stress factors as much as possible. From a vehicle health perspective, 
stressed employees are more likely to make errors by being distracted while on the 
job, and to be absent from the job (along with their experience) as a result of health 
problems. 

The SIAT believes that the findings reported here in the area of work force issues 
parallel those that were noted by the Aerospace Safety Advisory Panel. The SIAT 
is concerned that in spite of the Aerospace Safety Advisory Panel findings and rec- 
ommendations, supported by the present review, these problems remain. 
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Issue 8 

The size and complexity of the Shuttle system and of the NASA/contractor 
relationships place extreme importance on understanding, communication, 
and information handling. 

In spite of NASA’s clear statement mandate on the priority of safety, the nature 
of the contractual relationship promotes conflicting goals for the contractor (e.g., cost 
vs. safety). NASA must minimize such conflicts. To adequately manage such con- 
flicts, NASA must completely understand the risk assumptions being made by the 
contractor workforce. Furthermore, the SIAT observed issues within the Program in 
the communication from supervisors downward to workers regarding priorities and 
changing work environments. Communication of problems and concerns upward to 
the SSP from the “floor” also appeared to leave room for improvement. Information 
flow from outside the program (i.e., Titan program, Federal Aviation Administra- 
tion, ATA, etc.) appeared to rely on individual initiative rather than formal process 
or program requirements. Deficiencies in problem and waiver tracking systems, 
“paper” communication of work orders, and FMEA/CIL revisions were also apparent. 
The program must revise, improve and institutionalize the entire program commu- 
nication process; current program culture is too insular in this respect . 

Additionally, major programs and enterprises within NASA must rigorously de- 
velop and communicate requirements and coordinate changes across organizations, 
particularly as one program relies upon another (e.g., re-supplying and refueling of 
International Space Station by Space Shuttle). While there is a joint Program Re- 
view Change Board (PRCB) to do this, for instance on Shuttle and Space Station, 
it was a concern of the SIAT that this communication was ineffective in certain 
areas. 

Issue 9 

Due to the limitations in time and resources, the SIAT could not investigate 
some Shuttle systems and/or processes in depth. 

Follow-on efforts by some independent group may be required to examine these 
areas (e.g., other propulsion elements, such as the Reusable Solid Rocket Motor, 
Solid Rocket Booster, External Tank, Orbiter Maneuvering System, and Reaction 
Control System, and other wiring elements besides those in the Orbiter). This inde- 
pendent group should also review the SSP disposition of the SIAT findings and rec- 
ommendations. The Shuttle Upgrades program creates the opportunity to correct 
many of the observed deficiencies, e.g., the 76 areas of compromised redundancies 
(300+ circuits), and to incorporate design for maintainability and continuous im- 
provement. However, without careful systems integration and prioritization, some of 
the deficiencies observed by the SIAT will be exacerbated, e.g., in wiring, hydraulics, 
software, and maintenance areas. Additionally, the elements of maintenance must 
be rigorously analyzed, including training, maintainability, spares support mainte- 
nance, and accessibility. 

Return to Flight 

The SIAT was asked by the SSP for its views on the return to flight of STS-103. 
The SIAT had earlier considered this question and had concluded that a suitable 
criterion would be that STS-103 should possess less risk than, for example, STS- 
93. In view of the extensive wiring investigation, repairs and inspections that had 
occurred this ondition appeared to have been satisfied. Furthermore, none of the 
main engines scheduled to fly have pinned Main Injector liquid oxygen posts. The 
SIAT did suggest that prior to the next flight the SSP make a quantitative assess- 
ment of the success of the visual wiring inspection process. In addition, the SIAT 
recommended that the SSP pay particular attention to inspecting the 76 areas of 
local loss of redundancy and carefully examine the OV102 being overhauled at 
Palmdale for wiring damage in areas that were inaccessible on OV103. Finally, the 
team suggested that the SSP review in detail the list of outstanding waivers and 
exceptions that have been granted for OV103. The SSP is in the process of following 
these specific recommendations and so far has not reported any findings that would 
cause the SIAT to change its views. 

Shortly before completing this report, the SIAT was gratified to learn that a num- 
ber of steps had been taken by NASA to rectify a number of the adverse findings 
reported above. Of particular note was the strengthening of the NASA Quality As- 
surance function for the Shuttle at Kennedy Space Center. Upon completion of STS- 
103, the SIAT was pleased to learn that only two orbiter in-flight anomalies were 
experienced, a reduction from past trends (see Appendix 11 of the final summary). 

Senator Frist. Thank you, Dr. McDonald. 
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We will be back for questions for all of the panelists. Mr. Spear. 

STATEMENT OF TONY SPEAR, TASK LEADER, NATIONAL 

AERONAUTICS AND SPACE ADMINISTRATION’S 

FASTER, BETTER, CHEAPER REVIEW TEAM, PASADENA, 

CALIFORNIA 

Mr. Spear. Mr. Chairman, thank you for this opportunity to 
summarize the Faster, Better, Cheaper Task results. I got this job 
directly from Dan Goldin early in 1999, and finished up this Feb- 
ruary, during which I incorporated my personal experience and my 
team’s experience on the Mars Pathfinder mission with the results 
of a series of interviews and workshops with representatives from 
NASA, other agencies, industry, and academia. 

For most of my career, I worked at JPL, and retired in 1998. In 
1992, I was asked to plan and implement Mars Pathfinder, not 
only to land on Mars, but to invent a new way of doing business 
out there at JPL. I was asked to treat cost and schedule as impor- 
tantly as technical, and to develop and operate under cost and 
schedule caps. 

My summary conclusions, but first, let me answer a question 
often asked: Why did not the Mars 98 project use the Pathfinder 
airbags? On Pathfinder, we were midway through our airbag devel- 
opment without a credible design, when 1998 had to make their de- 
cision on their approach, so they chose a proven approach derived 
from Viking, a prudent approach at the time. 

Now, listed in my testimony is the rules of engagement, how to 
get into a Faster, Better, Cheaper mode. In my four pages there 
are ten steps. I am going to highlight No. 4. 

We formed an excellent team comprised of a few old-timers, 
scarred with experience, but most of the team were bright, ener- 
getic youth, bringing enthusiasm and new methods. Our Pathfinder 
team was the major reason for our success. By the way, at the start 
I was one of the bright, energetic youth. 

Now, in our interviews and workshops, it was not surprising that 
other successful, better, cheaper teams reported similar findings as 
to what made Faster, Better, Cheaper work. It was not anything 
magic, nothing new. It was back to basics, especially the impor- 
tance of people, teaming, and good communication. 

Then after much debate, we concluded that Faster, Better, 
Cheaper is simply attempting to continuously improve performance 
through efficiency and innovation, just that. But in addition, there 
is a teaming spirit associated with doing Faster, Better, Cheaper, 
and this intangible, the humanist versus the technicians won out, 
and this intangible element was made a part of our definition of 
Faster, Better, Cheaper. 

So then Faster, Better, Cheaper equates to all of NASA. It ap- 
plies to all missions, and work, and support, and all others in the 
Nation are at it, too. Everybody understands that we must im- 
prove, continuously improve to compete in the twenty-first century. 

There are two major challenges for Faster, Better, Cheaper. No. 
1, in our zeal we have gone too far in challenging projects to cut 
costs. We need to slow down some, move from a fixation on cost 
and near-term gain, and to do more careful planning. We have 
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made mistakes, and the mission failure rate, in my opinion, is too 
high. 

No. 2, Faster, Better, Cheaper precipitated a major transition 
within NASA from few to many missions, requiring many more 
project managers, teams, and institutional support, including re- 
view teams. 

Where do you go get suddenly all these new people? We caught 
the institution by surprise. At the same time there is a talent drain 
due to requirements, due to retirements, downsizing, and the loss 
to industry. 

The future for Faster, Better, Cheaper, the future equates to peo- 
ple, technology, and methods. On people, we must place a higher 
priority on acquisition, motivating, and training of people. We must 
develop incentives to attract good people and well-respected leaders 
to come work for NASA. Generating interest in NASA must start 
early in the schools. 

The results of this task need to be combined with the other in- 
vestigations to derive a common set of Faster, Better, Cheaper, les- 
sons-learned, and principles to form the basis for training the 
newly formed project teams. Now, this is within NASA, industry, 
and throughout academia. 

On technology, advanced technology is the better in Faster, Bet- 
ter, Cheaper, and we have not yet scratched the surface on its po- 
tential. Technology, in one way, is reducing the amount of work 
that projects need to do, as well as bringing down the cost of pow- 
erful, but small spacecraft, and accompanying reduction in launch 
vehicle costs is necessary, and must be a national priority if we are 
to remain a world leader in space. 

Combined with the low-cost spacecraft, this will lead to a major 
move into space by universities, developing countries, high-roller 
individuals who decide they want to have their own mission to 
Mars. 

On methods, methods involve expanding the multi-mission insti- 
tutional infrastructure support to the Faster, Better, Cheaper 
project teams. There is a list of things in my paper as to what that 
means. 

So core teams, with less project-unique systems to build, using 
more advanced multi-mission capability, and aided with a larger 
base of advanced technology, will become smaller in size. You will 
not need as big a team to do the job. The multi-mission capability 
will aid better the smaller teams. 

Then finally, the future of NASA is bright. I believe personally 
that Dan Goldin is right on with this Faster, Better, Cheaper 
thrust. He set the stage, created the proper environment, now all 
we need to do is follow through on implementation. 

The key word nowadays is implementation, a gaining from our 
lessons learned. Working hard in the trenches, executing, following 
through on the details and getting it right. 

Thank you. 

[The prepared statement of Mr. Spear follows:] 
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Prepared Statement of Tony Spear, Task Leader, National Aeronautics and 

Space Administration’s Faster, Better, Cheaper Review Team, 

Pasadena, California 

Mr. Chairman and members of the Subcommittee thank you for this opportunity 
to summarize the NASA FBC Task results. I was asked by the NASA Adminis- 
trator, Dan Goldin, to undertake this study of the Agency’s implementation of F ast- 
er, Better, Cheaper (FBC) in mid 1999. 

The FBC Task was conducted from July 1999 through February 2000, during 
which I incorporated my personal experience on the Mars Pathfinder Mission with 
the results of a series of interviews and workshops with representatives from NASA 
Headquarters, the NASA Centers, other Government Agencies, Industry, and Aca- 
demia. This has led to the conclusions presented here. 

INTRODUCTION 

For most of my career, 1962 to 1998, I worked on Deep Space Missions at the 
Jet Propulsion Labs, JPL, in Pasadena CA. I retired from JPL in 1998. 

In 1992, I was asked to plan and implement Pathfinder, challenged not only to 
land on Mars, but to “invent a new way of doing business at JPL.” 

I was to treat cost and schedule as importantly as technical and to develop and 
operate the mission under a cost cap of $265 million, including the lander, rover So- 
journer, flight operations and launch vehicle. Project development from start to 
launch took a little over three years. 

SUMMARY FBC TASK CONCLUSIONS 

First let me answer a question often asked: 

After the Mars 1998 Lander failure and during the final stages of this Task, I 
was asked: Why the Mars 1998 Lander did not use the Pathfinder airbags? 

In Pathfinder development, there was concern over our airbag landing approach, 
and we were only midway through its development when the Mars 1998 Project 
needed to make their landing approach decision. Since we had not completed a cred- 
ible design yet, the Mars 1998 Project choose a derivative of the proven Viking land- 
ing approach — a prudent decision under the circumstances at that time. 

HOW TO GET INTO THE FBC MODE— “FBC Rules of Engagement” 

Some of the key elements of Pathfinder’s success form the basis for the “FBC 
Rules of Engagement” developed in this Task: 

• We were given latitude to adjust mission scope to fit within the cost cap and 
initiated the project with adequate reserves to handle uncertainty. 

• Requirements did not change, and funds were provided at the right time. 

• Team members were extracted from their institutional home base at JPL and 
co-located in one big room around out test bed. We sought out the best expertise 
inside and outside of JPL. Our team was Nationwide. 

• We formed an excellent team comprised of a few old timers scarred with experi- 
ence, but with mostly bright energetic youth bringing enthusiasm and new 
methods. Our Team is the major reason for our success. 

• Each team member reporting directly to the project, removing layers of manage- 
ment in between, was truly empowered with cost and schedule as well as tech- 
nical responsibility for their project element. 

• We accomplished thorough mission, system and subsystem engineering and 
strict project planning, monitoring, and control. 

• Open and candid communication was important inside the Team and outside 
as well to management, the press and public. We agreed to place our data im- 
mediately on the Internet and to have CNN show our landing to the world. 

• We continuously assessed and mitigated risk throughout development and oper- 
ations, and did not think for a second we could fail because we were experi- 
menting with new ways. 

• We emphasized testing and training and followed through on details. 

• And, very importantly, we subjected ourselves to extensive peer review, infor- 
mal interactions with experts outside the project on all important project 
events — the best check and balance for FBC projects. 
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Not surprisingly, other successful FBC Teams throughout NASA, other Agencies, 
industry and academia reported similar findings as to what made FBC work, espe- 
cially the importance of people, teaming and good communication. 

And after much debate on just what is FBC, its definition, we concluded that FBC 
is simply attempting to continuously improve performance through efficiency and in- 
novation. 

But in addition, there is a “Teaming Spirit” associated with doing FBC which dis- 
tinguishes FBC Teams, this intangible element was made a part of the definition. 
On Pathfinder, all vendors, NASA Centers and other Agencies in support of Path- 
finder also got into the FBC Spirit. 

And FBC equates to all of NASA, applying to all missions and work in support 
of missions. Other Government Agencies, industry and academia are at it too. All 
realize we must improve to compete in the 21st Century information age and world 
economy. Of all the hundreds of people interviewed during this Task, no one said 
we should go back to the old way. All said we need to gain from our lessons learned 
and improve our FBC approach. 

SOME MAJOR CH ALL E N GES FOR FBC 

• In our zeal to do FBC, we have gone too far in challenging projects to cut cost. 
We need to slow down some, move from a fixation on cost and near term gain, 
and do more careful planning. 

For the 1st generation of FBC Missions, including Clementine, Near Earth Ren- 
dezvous, Lunar Prospector, Mars Global Surveyor, and Mars Pathfinder, scope fit 
well within cost and schedule caps. However, for some of the 2nd generation mis- 
sions, the challenge bar was raised too high. The cost cuts were too much. 

• FBC precipitated a major transition within NASA from few to many missions 
requiring many more project managers, teams, and institutional support includ- 
ing review teams. Management attention has become diluted across these many 
missions. At the same time, there is a talent drain due to retirements, 
downsizing, and loss to industry. 

Before with fewer missions, project managers worked up through the ranks for 
many years with “on the job training” to gain significant experience before they be- 
came project managers. Now with many missions this is not always possible, mak- 
ing training, mentoring, and peer review even more important. 

FUTURE FOR FBC 

To take FBC to the next level will require much dedication and teaming among 
NASA Headquarters, the NASA Centers and its industry and academia partners. 
It’s one thing to do FBC projects experiments, it’s another thing to institutional it. 

Future FBC equates to PEOPLE, TECHNOLOGY, METHODS. 

On people: We must place a higher priority on acquisition, motivation, training. 
We must develop incentives to attract good people and well-respected leaders to 
come to work for NASA. Generating interest in NASA must start early in the 
schools. While there is good work here, it needs higher priority. There is nothing 
better than involving students in real live missions, with some managed by stu- 
dents, with strong, encouraging assistance and mentoring by NASA expertise to give 
them a better chance to succeed. Let them navigate rovers on the Moon and Mars. 

The results of this FBC Task need to be combined with those of the two Mars 
Investigations to derive a common set of FBC lessons learned and principles to form 
the basis for FBC Training of newly formed project teams. 

On technology: Advanced technology is the “Better” in FBC and we have not 
scratched the surface yet on its potential. Soon projects, who now develop their com- 
munications links with their spacecraft, will be provided proven, advanced, multi- 
mission communications and data systems with “bug free” software — this will be 
like not having to build your own telephone every time you call home. 

Advanced tailor-able, multi-mission micro-electronics with intelligent systems will 
bring the cost of small, but powerful, reliable, automatic spacecraft matched to auto- 
mated, Internet driven ground support systems down to a few $ million so that uni- 
versities, developing countries and companies can explore space, have their own 
Mars mission. 

An accompanying reduction in launch vehicle costs is necessary and must be a 
National priority if we are to remain a world leader in space. Combined with the 
low cost spacecraft above, this will lead to an major move into space. 
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This is what NASA in the FBC mode must be about — paving the way for others 
to do space exploration by accomplishing high risk, but high payoff, enabling ad- 
vanced developments. 

On methods: Methods involves expanding the institution’s multi-mission support 
infrastructure in support of FBC project teams. 

Core FBC project teams with less project unique systems to build and aided with 
larger base of multi-mission support can become smaller in size. They will be sup- 
ported by: 

• Multi-missions pools of technical and managerial expertise and peer review ex- 
perts. 

• Advanced computer aided tools, processes, templates, model based design tech- 
niques, management standards and checklists, risk evaluation tools and train- 
ing. 

• Readably available lessons learned data bases. 

• Powerful electronic information links among NASA Headquarters, NASA Cen- 
ters and their industry and university partners; graphic visualization tools for 
virtual spacecraft design and for display of mission results. 

As well as: 

• The advanced, multi-mission technology mentioned above. 

The future for NASA is bright — looking for life “out there” and in building the 
bridge for humans to space. Dan Goldin is right on with his FBC thrust. He has 
set the stage, created the proper environment. Now all we need to do is follow 
through on better implementation of the exciting roadmaps and visions that have 
been generated. The key word is implementation. Getting it right. 

Senator Frist. Thank you, Mr. Spear. 

Mr. Stephenson. 

STATEMENT OF ARTHUR G. STEPHENSON, DIRECTOR, 

GEORGE C. MARSHALL SPACE FLIGHT CENTER, NATIONAL 

AERONAUTICS AND SPACE ADMINISTRATION 

Mr. Stephenson. Good afternoon, Mr. Chairman, and members 
of the Committee. Thank you for the opportunity to discuss the 
Mars Climate Orbiter Mishap Investigation Board’s report on 
project management in NASA. I have a brief opening statement, 
but I would ask that the Investigation Board’s entire report be en- 
tered into the record.* 

I am speaking today on behalf of the board members. It is our 
hope that this report will significantly help those involved in 
project management at NASA, and within the aerospace industry 
to successfully manage their projects during an era of limited re- 
sources. 

We believe that mission success can be achieved under the Fast- 
er, Better, Cheaper paradigm, but the approach to project manage- 
ment must be carefully managed with strict attention to four dis- 
tinct areas: Selection and training of the right people, use of proven 
project management processes, with a new emphasis on risk man- 
agement, disciplined execution of the project, and use of new, but 
adequately matured technology. 

Our initial report in November, 1999, addressed the root cause 
of the loss of the Mars Climate Orbiter mission as the failure to 
use metric units in the coding of ground software Small Forces 
used in trajectory modeling. This failure led to the navigator’s not 
fully understanding the trajectory of the spacecraft. This, in turn, 


* The information referred to has been retained in the Committee files. 
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led to errors in the trajectory correction propulsive maneuvers, and 
thus the spacecraft approached Mars too low for spacecraft sur- 
vival. 

The Board recognizes that mistakes and deficiencies occur on all 
spacecraft projects. It is imperative that spacecraft projects have 
sufficient processes in place to catch mistakes before they become 
detrimental to mission success. 

Unfortunately, for the Mars Climate Orbiter, the processes in 
place on the project did not catch the root cause, nor did these proc- 
esses enable the contributing causes, which we pointed out in our 
November report, to catch and correct this mistake. 

Following the loss of the Mars Polar Lander, Dr. Ed Wiler, 
NASA’s Associate Administrator for Space Science, amended our 
Board’s charter to develop recommendations based on an examina- 
tion of recent spacecraft failures. 

Our report on project management in NASA provides the fol- 
lowing: Observations and lessons learned from the Mars Climate 
Orbiter mission; a description of a well-run Faster, Better, Cheaper 
project; an assessment of NASA’s current project management 
guidelines and procedures; and recommendations for improved 
project management. 

Let me summarize the most significant findings and rec- 
ommendations documented in this report. Some projects have gone 
too far in emphasizing the importance of meeting cost and sched- 
ule, thereby introducing too much risk into the project. Project 
management, as well as NASA and industry senior managers, 
must be willing to push back and ask for more people and dollar 
resources in order to keep risk levels in check. An alternative 
might be to reduce project scope. 

However, if neither additional resources nor a reduction in 
project scope is achievable, then project management should rec- 
ommend cancellation rather than proceed with a project that car- 
ries too much risk. 

Within the eight failure investigations we examined, six reported 
that failure could be attributed to inadequate technical reviews, in- 
adequate risk management, and/or insufficient testing, analysis, 
and simulations. Our Board recommends that reviews must be con- 
ducted with the right highly qualified reviewers, including strong 
representation from functional line management. 

We recommend that risk management be raised in importance on 
NASA projects to a level equal to that traditionally given to cost, 
schedule, and project scope. In effect, this would make risk man- 
agement the fourth element in project management. 

Clearly, on some projects we have cut corners in testing, anal- 
ysis, and simulations. We must not give in to cutting corners when 
schedule and cost are tight. 

Communication on any team effort is key. We found inadequate 
communications on five of the eight failure investigations we 
looked into. Projects must have disciplined processes in place to en- 
able communications. This is not new to successful project manage- 
ment. It has just been shortchanged under the pressure to do more 
with less. 

Adequate staffing is another area that is sometimes short- 
changed because of limited resources. We must make sure that not 
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only is the staffing adequate, but also that people are the right 
ones and work well together. 

Last, let me say that technology is the key to Faster, Better, 
Cheaper strategy. We must have adequate funding to provide a 
pipeline of enabling technology to feed the daring missions we un- 
dertake. 

Cheaper does not mean just cutting cost. Cheaper missions result 
from the use of better technology. One needs only to look for a mo- 
ment at the information revolution we are experiencing. Tech- 
nology is the key to this success. 

Our board believes mission success is achievable on what I have 
called daring missions if we do these things. Sure, we will experi- 
ence failures, but that is because we are challenging the unknown, 
and we must learn as we go. Space exploration is inherently dif- 
ficult. There is not a lot that is new in these suggestions. We are 
underlining the need for execution of the fundamentals of project 
management, but without a return to the old ways of excessive gov- 
ernment oversight. 

Faster, better, cheaper is a great innovative approach. It does not 
mean throwing out the fundamentals of project management. It 
means using improved processes and improved technology in a dis- 
ciplined way. 

Thank you for the opportunity to share this report with you 
today. I believe our efforts, along with all of those asked to review 
recent mission failures, will help us better address current and fu- 
ture projects. 

[The prepared statement of Mr. Stephenson follows:] 

Prepared Statement of Arthur G. Stephenson, Director, George C. 

Marshall Space Flight Center, National Aeronautics and Space Adminis- 
tration 

The Mars Climate Orbiter Mishap Investigation Board’s Report on Project 

Management in NASA 

Good afternoon Mr. Chairman and members of the Committee. Thank you for the 
opportunity to discuss the Mars Climate Orbiter Mishap Investigation Board’s “Re- 
port on Project Management in NASA.” I am speaking today on behalf of the Board 
members. It is our hope this report will significantly help those involved in project 
management at NASA and within the aerospace industry to successfully manage 
their projects during an era of limited resources. We believe that mission success 
can be achieved under the “Faster, Better, Cheaper” paradigm but the approach to 
project management must be carefully managed with strict attention to four distinct 
areas: 

1. Selection and training of the right people 

2. Use of proven project management processes with a new emphasis on risk 
management 

3. Disciplined execution of the project 

4. Use of new but adequately matured technology 

Our initial report in November 1999 addressed the root cause of the loss of the 
Mars Climate Orbiter mission as the “failure to use metric units in the coding of 
ground software ‘Small Forces’ used in trajectory modeling.” This failure led to the 
navigators not fully understanding the trajectory of the spacecraft. This, in turn, led 
to errors in the trajectory correction propulsive maneuvers, and thus the spacecraft 
approached Mars too low for spacecraft survival. 

The Board recognizes that mistakes and deficiencies occur on all spacecraft 
projects. It is imperative that spacecraft projects have sufficient processes in place 
to catch mistakes before they become detrimental to mission success. 

Unfortunately for the Mars Climate Orbiter, the processes in place on the project 
did not catch the root cause. Nor did these processes enable the contributing 
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causes — which we pointed out in our November report — to catch and correct this 
mistake. 

Following the loss of the Mars Polar Lander, Dr. Ed Weiler, NASA’s Associate Ad- 
ministrator for Space Science, amended our Board’s charter to develop recommenda- 
tions based on an examination of recent spacecraft failures. 

Our “Report on Project Management in NASA” provides the following: 

• Observations and lessons learned from the Mars Climate Orbiter mission 

• A description of a well-run “Faster, Better, Cheaper” project 

• An assessment of NASA’s current project management guidelines and proce- 
dures 

• Recommendations for improved project management 

Let me summarize the most significant findings and recommendations docu- 
mented in this report: 

• Some projects have gone too far in emphasizing the importance of meeting cost 
and schedule, thereby introducing too much risk into the project. Project man- 
agement, as well as NASA and industry senior managers, must be willing to 
push back and ask for more people and dollar resources in order to keep risk 
levels in check. Or, an alternative might be to reduce project scope. However, 
if neither additional resources nor a reduction in project scope is achievable, 
then project management should recommend cancellation rather than proceed 
with a project that carries too much risk. 

• Within the eight failure investigations we examined, six reported that failure 
could be attributed to inadequate technical reviews, inadequate risk manage- 
ment, and/or insufficient testing, analysis, and simulations. Our Board rec- 
ommends that reviews must be conducted with the right, highly qualified re- 
viewers, including strong representation from functional line management. We 
recommend that Risk Management be raised in importance on NASA projects 
to a level equal to that traditionally given to Cost, Schedule, and Project Scope. 
In effect, this would make Risk Management the “fourth” element in project 
management. Clearly, on some projects we have cut corners in testing, analysis, 
and simulations. We must not give in to cutting corners when schedule and cost 
are tight. 

• Communication on any team effort is key. We found inadequate communica- 
tions in five of the eight failure investigations we looked into. Projects must 
have disciplined processes in place to enable communications. This is not new 
to successful project management — it has just been shortchanged under the 
pressure to do more with less. 

• Adequate staffing is another area that was sometimes shortchanged because of 
the limited resources. We must make sure that not only is the staffing ade- 
quate, but also that the people are the right ones and work well together. 

• Lastly, let me say that technology is key to the “Faster, Better, Cheaper” strat- 
egy. We must have adequate funding to provide a pipeline of enabling tech- 
nology to feed the daring missions we undertake. “Cheaper” does not mean just 
cutting cost. Cheaper missions result from the use of better technology. One 
needs only to look for a moment at the information revolution we are experi- 
encing. Technology is the key to it. 

• Our Board believes mission success is achievable on what I have called daring 
projects if we do these things. Sure, we will experience failures — but that is be- 
cause we are challenging the unknown and we must learn as we go. Space ex- 
ploration is inherently difficult. 

• There is not a lot that is new in these suggestions — we are underlining the need 
for execution of the fundamentals of project management but without a return 
to the old ways of excessive government oversight. “Faster, Better, Cheaper” is 
a great, innovative approach — it does not mean throwing out the fundamentals 
of project management. It means using improved processes and improved tech- 
nology in a disciplined way. 

Thank you for the opportunity to share this report with you today. I believe our 
efforts — along with all those asked to review the recent mission failures — will help 
us better address current and future projects. 
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Final Report on Project Management in NASA 

by the Mars Climate Orbiter Mishap Investigation Team 

Released March 13, 2000. The report is available at http: / / www.nasa.gov / 
newsinfo / publicreports. html 

Executive Summary 

This second report and final report, prepared by the Mars Climate Orbiter Mishap 
Investigation Board, presents a vision and recommendations to maximize the prob- 
ability of success for future space missions. The Mars Climate Orbiter Phase I Re- 
port, released Nov. 10, 1999, identified the root cause and factors contributing to 
the Mars Climate Orbiter failure. The charter for this second report is to derive les- 
sons learned from that failure and from other failed missions — as well as some suc- 
cessful ones — and from them create a formula for future mission success. 

The Mars Climate Orbiter mission was conducted under NASA’s “Faster, Better, 
Cheaper” philosophy, developed in recent years to enhance innovation, productivity 
and cost-effectiveness of America’s space program. The “Faster, Better, Cheaper” 
paradigm has successfully challenged project teams to infuse new technologies and 
processes that allow NASA to do more with less. The success of “Faster, Better, 
Cheaper” is tempered by the fact that some projects and programs have put too 
much emphasis on cost and schedule reduction (the “Faster” and “Cheaper” ele- 
ments of the paradigm). At the same time, they have failed to instill sufficient rigor 
in risk management throughout the mission lifecycle. These actions have increased 
risk to an unacceptable level on these projects. 

The Mishap Investigation Board conducted a series of meetings over several 
months with the Jet Propulsion Laboratory and Lockheed Martin Astronautics to 
better understand the issues that led to the failure of the Mars Climate Orbiter. 
The Board found that the Mars Surveyor Program, agreed to significant cuts in 
monetary and personnel resources available to support the Mars Climate Orbiter 
mission, as compared to previous projects. More importantly, the project failed to 
introduce sufficient discipline in the processes used to develop, validate and operate 
the spacecraft; nor did it adequately instill a mission success culture that would 
shore up the risk introduced by these cuts. These process and project leadership de- 
ficiencies introduced sufficient risk to compromise mission success to the point of 
mission failure. 

It should be noted that despite these deficiencies, the spacecraft operated as com- 
manded and the mission was categorized as extremely successful until right before 
Mars orbit insertion. This is a testament to the hard work and dedication of the 
entire Mars Climate Orbiter team. The Board recognizes that mistakes and defi- 
ciencies occur on all spacecraft projects. It is imperative that all spacecraft projects 
have sufficient processes in place to catch mistakes before they become detrimental 
to mission success. Unfortunately for the Mars Climate Orbiter, the processes in 
place did not catch the root cause and contributing navigational factors that ulti- 
mately led to mission failure. 

Building upon the lessons learned from the Mars Climate Orbiter and a review 
of seven other failure investigation board results, this second report puts forth a 
new vision for NASA programs and projects — one that will improve mission success 
within the context of the “Faster, Better, Cheaper” paradigm. This vision, Mission 
Success First, entails a new NASA culture and new methods of managing projects. 
To proceed with this culture shift, mission success must become the highest priority 
at all levels of the program/project and the institutional organization. All individuals 
should feel ownership and accountability, not only for their own work, but for the 
success of the entire mission. 

Examining the current state of NASA’s program and project management environ- 
ment, the Board found that a significant infrastructure of processes and require- 
ments already is in place to enable robust program and project management. How- 
ever, these processes are not being adequately implemented within the context of 
“Faster, Better, Cheaper.” To move toward the ideal vision of Mission Success 
First, the Board makes a series of observations and recommendations that are 
grouped into four categories, providing a guide by which to measure progress. 

(1) People 

The Board recognizes that one of the most important assets to a program and 
project is its people. Success means starting with top-notch people and creating the 
right cultural environment in which they can excel. Thus, Mission Success First 
demands that every individual on the program/project team continuously employ 
solid engineering and scientific discipline, take personal ownership for their product 
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development efforts and continuously manage risk in order to design, develop and 
deliver robust systems capable of supporting all mission scenarios. 

Teamwork is critical for mission success. Good communication between all project 
elements — government and contractor, engineer and scientist — is essential to main- 
taining an effective team. To ensure good teamwork, the project manager must 
guarantee an appropriate level of staffing, and all roles and responsibilities must 
be clearly defined. 

(2) Process 

Even the best people with the best motivation and teamwork need a set of guide- 
lines to ensure mission success. In most cases NASA has very good processes in 
place, but there are a few areas for improvement. 

A concise set of mission success criteria should be developed and frozen early in 
the project life cycle. 

During the mission formulation process, the program office and the project should 
perform the system trades necessary to scope out the expected costs for mission suc- 
cess. This should be accomplished independently of any predefined dollar cap. If nec- 
essary, consider mission scope changes to drive the costs to a level that the program 
can afford. Scope should never be decreased below a minimum threshold for science 
and for technical achievement as defined by the mission success criteria. 

Both the project and the program should hold adequate contingency reserves, to 
ensure that mission success is achievable. Projects and programs that wind up with 
inadequate funding should obtain more funds or consider cancellation before pro- 
ceeding with inadequate funds. 

Close attention should be paid from project outset to the plan for transition be- 
tween development and operations. Adequate systems engineering staffing, particu- 
larly a mission systems engineer, should be in place to provide a bridge during the 
transition between development and operations, and also to support risk manage- 
ment trade studies. 

Greater attention needs to be paid to risk identification and management. Risk 
management should be employed throughout the life cycle of the project, much the 
way cost, schedule and content are managed. Risk, therefore, becomes the “fourth 
dimension” of project management — treated equally as important as cost and sched- 
ule. 

Project managers should copy the checklist located in the back of this report, put- 
ting it to constant use and adding to it in order to benchmark the performance of 
their project team. Moreover, this checklist should be distributed to all members of 
the project team as a 360-degree benchmark tool, to identify and reduce potential 
risk areas. 

(3) Execution 

Most mission failures and serious errors can be traced to a breakdown in existing 
communication channels, or failure to follow existing processes — in other words, a 
failure in execution. To successfully shift to the Mission Success First culture, it 
is necessary for the institutional line management to become more engaged in the 
execution of a project. As such, line managers at the field centers need to be held 
accountable for the success of all missions at their centers. 

Let us be clear that this role of institutional line management accountability 
should not be construed as a return to the old management formula, wherein NASA 
civil servants provided oversight for every task performed by the contractor or team. 
Instead, we recommend that NASA conduct more rigorous, in-depth reviews of the 
contractor’s and the team’s work — something that was lacking on the Mars Climate 
Orbiter. 

To accomplish this, line management should be held accountable for asking the 
right questions at meetings and reviews, and getting the right people to those re- 
views to uncover mission-critical issues and concerns early in the program. Institu- 
tional management also must be accountable for ensuring that concerns raised in 
their area of responsibility are pursued, adequately addressed and closed out. 

Line organizations at the field centers also must be responsible for providing ro- 
bust mechanisms for training, mentoring, coaching and overseeing their employees, 
project managers and other project team leaders. An aggressive mentoring and cer- 
tification program should be employed as the first step toward nurturing competent 
project managers, systems engineers and mission assurance engineers for future 
programs. 

Line organizations, in conjunction with the projects, also must instill a culture 
that encourages all internal and external team members to forcefully and vigorously 
elevate concerns as far as necessary to get attention within the organization. Only 
then will Mission Success First become a reality. 
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(4) Technology 

Technological innovation is a key aspect in making the “Faster, Better, Cheaper” 
approach a reality. Through such innovation, smaller, lighter, cheaper, and better- 
performing systems can be developed. In addition, innovative processes enable 
quicker development cycles. To enable this vision, NASA requires adequately funded 
technology development, specifically aimed at Agency needs. Programs and projects 
must conduct long-range planning for and champion technology infusions resulting 
in delivery of low-risk products for project incorporation. 

Mechanisms which minimize technology infusion risk, such as the New Millen- 
nium Program, should be employed to flight-validate high risk technologies prior to 
their use on science missions. 

Agenda for the Future 

The Mars Climate Orbiter Mishap Investigation Board perceives its recommenda- 
tions as the first step in an agenda that will be revisited and adjusted on an ongoing 
basis. The aim is to make Mission Success First a way of life — a concern and re- 
sponsibility for everyone involved in NASA programs. 

The recommendations of this report must trigger the first wave of changes in 
processes and work habits that will make Mission Success First a reality. To im- 
plement this agenda with a sense of urgency and propagate it throughout the Agen- 
cy, NASA Headquarters and the NASA centers must address the recommendations 
presented in this report. NASA must further assign responsibility to an organization 
(such as the Office of the Chief Engineer) for including the recommendations in 
Agency policy and in training courses for program and project management. 

These actions will ensure that Mission Success First serves as a beacon to 
guide NASA as the future unfolds. 

Senator Frist. Thank you, Mr. Stephenson. 

Mr. Li, you mentioned a number of Shuttles last year, I guess 
it was four last year. We talked about downsizing. Could you relate 
the two to me? You mentioned that NASA’s downsizing on the 
Shuttle program coincided with the decrease in the number of 
flights in 1996, 1997, and 1998. Would this downsizing have been 
possible without the decrease in the number of flights? What is 
that relationship? 

Mr. Li. I believe that it is a serendipitous relationship. The fact 
of the matter is, with the decreased work force, they were able to 
maintain and provide safe operations with the Shuttle fleet. How- 
ever, had they gone to the higher rate, which they were expected 
to have, to build the Space Station, I am afraid that margin of safe- 
ty would not have been as great. And I believe that Dr. McDonald’s 
report supports that statement. 

Senator Frist. With the increases slated for fiscal years 2000 
and 2001, are those increases sufficient for the expected increase 
in workload that you pointed out will take place in the Shuttle? 

Mr. Li. What I have done is, I have reviewed the Office of Space 
Flight projects for what that organization would need in order to 
support the Space Station and to perform their Shuttle flights. I 
believe that those numbers are reasonable within that realm. 

I cannot say that those numbers will, indeed, be sufficient, but 
I think it is going in the right direction. However, I would like to 
add that, as I said in my prepared statement, adding engineers is 
not sufficient to resolve the problem. They need to have an overall 
implementation strategy that is much broader in scope. 

Senator Frist. Dr. McDonald, in your comments and your old 
testimony on touch labor, increased numbers of inspections, you 
had mentioned that the wiring damage that led to the short on the 
STS-93 is suspected to have been caused four or five years prior 
to that. 
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Last fall, NASA conducted extensive wiring inspections on all the 
Shuttle orbiters. In accordance with NASA procedures, how often 
is this type of wiring inspection required? 

Dr. McDonald. The standard procedure would require the wir- 
ing to be examined on every flight. 

Senator Frist. Is that sufficient? Again, you mentioned the fact 
that you have people working side by side, where damage is inad- 
vertently caused. Is inspection with every flight sufficient? 

Dr. McDonald. Our recommendation was that they enhance the 
degree of inspection and make it a focal point, particularly in the 
area where redundancy had been compromised. We also believe 
that the agency should embark upon technology to relieve the rath- 
er difficult task imposed on the inspectors. The inspectors in many 
cases have to use a ten-times magnifying glass and a light, an in- 
tense light beam, and we felt that technology could assist in that 
process. 

So we know the realization of the damage that can and has oc- 
curred to capped-on wiring on the vehicle, the renewed attention to 
details by the staff should mitigate the problem, but it will require 
intensive surveillance to ensure that this is kept safe. 

Senator Frist. The databasing that you mentioned, I understood 
it to mean that if you had an adequate computerized database and 
identified certain deficiencies, that it would — the collection of that 
data, analysis of that data would bring things to management’s at- 
tention earlier on. 

Dr. McDonald. Yes, sir. That was the observation. 

Senator Frist. That would seem to be a standard practice. Does 
that mean more computerization, or more data entry, or what does 
it mean, more importantly? 

Dr. McDonald. The problem goes back a number of years, actu- 
ally the Rogers’ Commission suggested that a computerized data- 
base be constructed, so it was constructed in the mid-eighties. 

And as such, in the present time, it is a legacy system that is 
somewhat outdated, and the agency is now undertaking a very se- 
rious look at that system to see how it could be modified in light 
of the significant process and database management that has oc- 
curred in the last 14 years. 

Senator Frist. Mr. Spear, in your written testimony, the Faster, 
Better, Cheaper strategy you say precipitated a major transition 
within NASA from few to many missions, requiring many more 
project managers, teams, and institutional support, including re- 
view teams. 

Should NASA decrease its number and scope of missions, do you 
think, if success and safety, which we come back to again and 
again over the course of the hearing today, is accomplished? 

Mr. Spear. One of the things we recommended is that NASA 
slow down a little, and do better planning. In our major report, 
which I entered into testimony, I recommend that there are not 
only project reviews, but program reality checks as to whether the 
projects really do, in fact, fit under the funding profile. 

I believe in training. I believe in a mix of experience-based peo- 
ple, with the young people. The young people can do a lot. I believe 
in what I call three badges of courage. Each project needs to have 
some type of informal certification by the institution, not some bu- 
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reaucratic process, but some way of assessing, hey, this is a good 
mix of a team. 

The second badge of courage is a risk signature. Each project has 
its own fingerprints, per se. Some projects are higher risk, some 
are less risk. On one sheet we can illustrate that risk for each 
project. I think we owe that to the nation, this risk signature. 

A third thing, we will now compile all these checklists, and all 
the lessons learned, all the rules of engagement into a set of Fast- 
er, Better, Cheaper ways of doing business. There ought to be a 
metric, a simple check, as Art Stephenson as laid out in his report, 
yearly, or maybe every 6 months, as to how well each project is 
doing in this Faster, Better, Cheaper mode. Those three things, 
which could be three pieces of paper, would be dramatic, visual sta- 
tus reports on a project. 

Senator Frist. Mr. Stephenson, is that consistent with both your 
findings and recommendations? 

Mr. Stephenson. Yes, it is. 

Senator Frist. Thank you. Mr. Stephenson, you mentioned unac- 
ceptable level of risk management in your testimony on the Mars 
Climate Orbiter. How would that have been determined in ad- 
vance? We had this whole Faster, Better, Cheaper paradigm. How 
would we have figured that out earlier? 

Mr. Stephenson. Well, when we were asked to go look at the 
failure, following the failure, we were asked first of all for the risk 
management processes, so that we could see what had been con- 
ducted in terms of risk assessment, and we found that it was lack- 
ing, and that was the finding of our report. We would expect to see 
a “fault tree” analysis, and we did not see that. 

We did not sense that there was enough in the review process, 
and I mentioned inadequate reviews, that said what could go 
wrong with this mission, and in searching for the possibilities of 
failure, and what we found in the case of the Mars Climate Orbiter 
was that there was not even a peer review of the navigation team. 
So there was not an adequate effort toward assessing risk and 
dealing with it. 

Chairman Frist. Thank you. Senator Breaux. 

Senator Breaux. Thank you, Mr. Chairman, and I thank all of 
our distinguished panelists this afternoon for being with us and 
providing very valuable information. I am just trying to figure out 
who is doing what and who is on first. 

We have everybody looking at one aspect of NASA. We have 
GAO, I guess, looking at all of it. Dr. McDonald, you are in charge 
of the Space Shuttle Independent Assessment Team. 

Mr. Spear, you are doing the “Faster, Better, Cheaper” Review 
Team, Mr. Stephenson, you are doing the Mars Climate Orbiter 
Mishap Investigative Board report on project management in 
NASA. I mean it looks like everybody is out there just sifting 
through all the information that could possibly be turned up in 
NASA. 

I mean is it too much? I mean are we coordinating here? It seems 
to me, it must be awfully crowded. It looks like you are all looking 
at some of the same things, and maybe from a different perspec- 
tive. That may be good. I do not know. 
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Mr. Stephenson. Well, I can respond to that. I think, at least 
in the case of the Mars activity, of course, Tony was already under- 
way in his studies, and so our Board, when we expanded our role 
in looking at mission studies and failure, asked Tony to come and 
brief us, so we were aware of the findings that Tony was coming 
to, and incorporated those in our report. 

So I think we had an opportunity to exchange ideas and test on 
our own what Tony was saying. So I think our two reports are con- 
sistent, not the same, but we agree on what our findings are. 

Senator Breaux. Mr. Spear, did you have a comment? 

Mr. Spear. I appeared in front of both Tom Young’s and Art 
Stephenson’s Board, and we shared our experiences and our re- 
sults, but after a post-task debrief, I had a meeting with Dan 
Mulville, and he indicated that the NASA chief engineer is going 
to now consolidate all the findings, interact with us as to, OK, is 
this really representative of the results of all the three investiga- 
tions, and then that is going to spawn a training course, a training 
course on Faster, Better, Cheaper, as to, here is the definition, here 
are the checklists as to how you do Faster, Better, Cheaper, and 
then this is going to be taught all around NASA, but not only 
NASA, with industry and universities. 

Senator Breaux. So is that going to be one book then as a result 
of all of this on recommendations? 

Mr. Spear. That is my understanding. 

Senator Breaux. It would seem to me, if we have all these dif- 
ferent reports running around, one group is going to read one, an- 
other group is going to read another one, another group may not 
get them all. 

It would seem to be very helpful if we had everything in a con- 
cise book of recommendations on what needs to be done and what 
type of process needs to be followed for the future, and coordinate 
what we are doing. Otherwise, it is going to be uncoordinated, and 
not very useful. 

Mr. Li. Senator Breaux, I would like to address your question in 
terms of the three gentlemen on my right here, obviously, all are 
NASA individuals. 

Senator Breaux. Yes. 

Mr. Li. The General Accounting Office is here to assist the Con- 
gress in its oversight of NASA, and we perform an independent as- 
sessment, an objective assessment of the facts, and we provide that 
to the Congress. 

Senator Breaux. Well, I want to followup on that. Dr. McDonald, 
I know that you led the team effort, but you also had NASA and 
contractors. I mean is your Space Shuttle and independent assess- 
ment team reoport truly independent, if you have NASA involved 
in looking at NASA? 

Dr. McDonald. Well, I believe it was, sir, because the NASA em- 
ployees were not from the centers involved directly. 

Senator Breaux. They still get paid by the same check. 

Dr. McDonald. Yes, sir, but I think the overriding consideration 
for all the NASA people was the safety of the Shuttle. 

Senator Breaux. I understand that, and I appreciate what you 
are saying, but I think Mr. Li knows why we depend on GAO so 
much, because it is separate and truly independent in everything 
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it does. I am not criticizing the report, but it seems to me that the 
fact that you called it the “independent assessment team,” and it 
has people from NASA doing it, seems like it compromises the 
independence of the investigation. 

Dr. McDonald. Well, I do not believe it did, sir, and I think any- 
one who tried to muzzle, for example, Rear Admiral Don Eaton 
would be on a losing track. 

Senator Breaux. Well, I understand that, but I mean it would 
be like asking the Commerce Committee to assess the Finance 
Committee. I am sure that you may not get the best results. 

I think it is within the bosom of the law, looking at each other 
and saying, you know, how are you doing, and there is a tendency 
to say, “Well, we are doing really well. Thank you very much.” 

Dr. McDonald. As you say. 

Senator Breaux. No, it is not. I mean I am here to learn from 
you guys. I mean I am just disturbed by the fact that it is called 
an independent assessment team, and part of the people on the 
team are part of the group that you are looking at and assessing. 
I just do not know how that is possible. 

Dr. McDonald. Sir, I think the basic observation is that there 
were a few NASA people on it. None of them were directly involved 
in the human space flight program. There were a majority of non- 
NASA people, DOD, and some contractors were 

Senator Breaux. Were the contractors also doing work for 
NASA? 

Dr. McDonald. No, sir, they were not. 

Senator Breaux. They are not? 

Dr. McDonald. They were from McDonnell-Douglas Air Frame 
Systems, or no, Boeing Aircraft. They were working on the MD-11 
investigation. 

Senator Breaux. Well, I mean, I think that you heard Dan 
Goldin speak very clearly that he appreciates and wants it to be 
independent, and not to have him investigate his own shop, I 
think. I think it is very important to maintain that independence 
to the degree that we can. 

I take, Mr. Spear, when we talk about faster, better, and cheap- 
er, it seems like you are saying we have been focusing too much 
on the cheaper and the cost. 

Mr. Spear. That is true, and there has been much pressure, and 
now we need to back off a little bit, and do better planning, and 
continue, but continue in a more disciplined approach, according to 
the rules of engagement, we call them, the Faster, Better, Cheaper 
rules of engagement, that are now coming out of my report, Art’s 
and Tom’s reports — investigation. 

Senator Breaux. I asked Administrator Goldin about the article 
by James Oberg from UPI and I think he shucked it to Mr. Ste- 
phenson, to comment on. 

Mr. Stephenson. Yes. 

Senator Breaux. I do not know what happened or what did not 
happen, I was just reading this as a concerned member of the Com- 
merce Committee. Some of the things contained in this article dis- 
turb me, and I think probably disturb everybody. We are looking 
for some answers because, according to this writer, he said, as ex- 
plained privately to him, the Mars Polar Lander vehicle’s breaking 
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thrusters had failed acceptance testing during its construction. 
Rather than begin an expensive and time-consuming redesign, an 
unnamed space official simply altered the conditions of the testing 
until the engine passed. 

Now, there is an awful lot of openness to that statement. So you 
can take it to say that the test conditions were changed in order 
to certify the engine’s performance. 

That, to me, is an incredibly serious charge, that if the equip- 
ment does not pass the test, do not change the equipment, change 
the test. I know a lot of students would probably like to have that 
happen to them in school, if you cannot pass the test, throw out 
the test and get a new test. It is, in essence, what they are saying 
here, and it is very disturbing. Can you shed any light, whatsoever, 
on how that occurred, or what happened, in fact? 

Mr. Stephenson. Well, I can tell you that we have been trying 
very hard to understand that statement, because we can find no 
evidence anywhere that that was done. 

Senator Breaux. You would have records of, or have access to 
the records of the testing of various systems 

Mr. Stephenson. Yes. 

Senator Breaux. — such as this. 

Mr. Stephenson. Yes. I would expect that NASA, with Lockheed 
Martin, would have records, and we have not 

Senator Breaux. You have not seen the tests on this particular 
piece of equipment to certify whether, in fact, the test was given, 
that the equipment did not pass, and then a different test was 
given, and then the equipment was certified. 

Mr. Stephenson. I have no knowledge of that, and I have asked 
over the last 12 hours everyone I can find, and I am not aware of 
it. We certainly were not aware of it during our investigation. 

We pointed out an issue that was pursued with vigor by JPL and 
Lockheed Martin, and I have no knowledge that anyone surfaced 
during any of these investigations any evidence of what I would 
consider a probable 

Senator Breaux. Has anybody in your shop had a chance to re- 
view the actual tests that were given to this particular piece of 
equipment? 

Mr. Stephenson. I cannot say that we have in the detailed level 
that we are talking about here. My shop 

Senator Breaux. It would be helpful to pull up in the files what 
the tests were, and to say whether, in fact, there was one test that 
was not successfully completed, and then there was a second dif- 
ferent test that, in fact, was. 

Mr. Stephenson. I have no knowledge of that. Let me say that 
when we uncovered the issue, we discovered that the test program 
had not been tested at the cold temperatures that we felt it should, 
and Mr. Sackhiem, who was on my Committee, who is a propulsion 
expert, recommended that they go back and reexamine it, and 
there was a team formed by JPL and Lockheed Martin to go back 
and conduct an investigation, and to run tests. 

What they found was that they needed to raise the temperature 
of those cat beds before going into Mars, and they did redesign the 
mission to turn on the power to heaters on those cat beds, on the 
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thrusters, about ten or twelve hours prior to the use of the thrust- 
ers. So there was an acknowledgment that there was an issue. 

I would not be surprised if they tested at a temperature that was 
too warm, because they did not produce the test data when we 
asked the question. They went back and did a ground test less than 
a month prior to landing on Mars. 

So we uncovered an issue, it was addressed, I think, adequately 
and thoroughly by JPL and Lockheeed Martin, and they changed 
the mission design to address it. I have no knowledge of anyone 
running a test and falsifying the results. 

Senator Breaux. Do you feel confident that you have explored 
every avenue in that regard, to determine whether, in fact, it may 
have happened without your knowledge? 

Mr. Stephenson. No. I think we need to go back and look at it 
real hard, based on this allegation, but I am telling you, at this 
point, we have no knowledge, and we will certainly be happy to 

Senator Breaux. It would seem to me, and good Lord, I am the 
last person to become an expert on the internal operations of 
NASA, by a far stretch, but it would seem to me that the tests that 
NASA administers to certify equipment would be a matter that the 
record is kept somewhere. 

Mr. Stephenson. Absolutely. 

Senator Breaux. So if this particular piece of the breaking 
thrusters, I guess, was tested for the first test, you would have the 
results, and if you had a second test or a third test, you would have 
the results of each one of the tests, and they would be pretty sim- 
ple to find. 

Mr. Stephenson. Correct. I just do not have that confirmation. 
Let us take that action and get back to this Committee, and give 
you that answer. 

Senator Breaux. Yes. I would think it would be helpful to find 
out exactly what happened, because I guarantee Members of Con- 
gress are going to be getting letters from constituents — and right- 
fully so — saying, look, I read this thing, this is not a good story, 
and can you respond to it. I am going to say, well, I am going to 
do that as soon as I hear from Mr. Stephenson. 

Mr. Stephenson. Our initial 

Senator Breaux. Should I just tell them to call you? 

Mr. Stephenson. Our initial response is, we do not believe that 
this is correct statement, but we need to go back and look at the 
data again. 

Senator Breaux. Well, I appreciate it. I am not being critical of 
you at all. I think that we just need to have it looked at, and then 
we can be given a definitive response as to whether there is any 
information that maybe the tests were done several times, and 
then changed. 

Mr. Stephenson. I will do that. 

Senator Breaux. Thank you. I appreciate the panel. Thank you 
very much. 

Senator Frist. Mr. Li, you mentioned that the age profile of the 
workers at Kennedy reversed just 6 years ago from twice as many 
workers under 30 years of age to twice the number of workers over 
60 years of age. Why is that? 
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Mr. Li. I think it is obvious, NASA was not able to hire. They 
had no stream of new employees that were able to come in and cre- 
ate new blood. 

As a result, that percentage, as you are saying — in fiscal year 
1993, the Office of Space Flight, for the people who were under 30, 
they comprised 17 percent of the work force. In fiscal year 1999, 
now they comprise 3 percent of that work force. Obviously, some- 
thing is happening. 

Senator Frist. Say the reason again. Obviously, what? 

Mr. Li. Because they were not able to hire. NASA 

Senator Frist. They were not able to hire. What does that mean? 

Mr. Li. They did not hire, because they were in a downsizing 
mode. It is not a matter of them not wanting to. They had a strat- 
egy that they were going to drop from over 20,000 employees down 
to 18,500. Their strategy was obviously not, as we heard earlier 
this afternoon, to have any involuntary separations. They wanted 
to have voluntary separations. They had buyouts, and through that 
downsizing, they did not hire anybody. 

Senator Frist. As this great hiring process goes on, as everybody 
has said, it cannot be just the hiring process itself, do you think 
those ratios will turn back to what they were? 

Mr. Li. I am hopeful. I think there is one thing that the Adminis- 
trator mentioned last week in a hearing that I thought was very 
important, in that he feels that the hiring of employees should be 
looked at from two perspectives, one, from a short-term perspective, 
because, as he said earlier this afternoon, it is very difficult to re- 
tain these bright, bright people coming out of college, they are not 
going to stay in the government, we just cannot compensate them 
enough; however, the excitement of working at NASA is enough to 
keep them for, perhaps, two or 3 years. 

He has that plan to keep those people there for a while, but he 
also recognizes that he has to keep institutional knowledge, and he 
also wants to hire people for longer periods. 

Senator Frist. When we talk about a mentoring program, and it 
has been mentioned indirectly by a lot, you had these sort of short- 
term focused projects, team spirit, people pulling together, you 
know, going through the night, you have all these visions of a real 
team. Can it really go on in that environment on a project, like Mr. 
Spears? I mean if you basically said I have to be in the job of men- 
toring at the same time I have this three-, or four-, or 5-year 
project, what do you do? 

Do you take the gray-haired person who has been around a 
while, one of the old guys, whatever your words were, and you pair 
him up, and you say, OK, you are the mentor, because this young 
fellow may or may not leave, and they are more likely to leave if 
they are not — how do you 

Mr. Li. I think there has to be a specific goal, and it has to be 
explicit that the Agency’s strategy and objective is to have that 
mentoring. In the environment that has happened recently, be- 
cause they had so much work, and also, obviously, because they did 
not have enough young people to mentor, that did not happen. 

But I really think that if there is that push now to do and per- 
form mentoring — mentoring, to me, is taking somebody under their 
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wing and trying to teach them on the job, this is how you do these 
things. 

Senator Frist. What incentive is there — Mr. Spear, you can jump 
in. How do you reward that person? You said mentoring is impor- 
tant. Are you going to get paid more? How do you incorporate that 
in this Faster, Better, Cheaper team spirit, pull ahead, we are 
going to produce in a short period of time for less? Is it possible? 
How do you incentivize it, Mr. Spear? 

Mr. Spear. First of all, Senator, mentoring can only go so far. 
You can only teach this new person, this young person, your experi- 
ence, to a certain degree. Sometimes it is just hard for them to 
fathom what you are telling them. So the team has to be a balance. 
It always has to be a balance. 

It cannot just be youth and inexperience. There has to be people 
with on-the-job training. Nothing works better than on-the-job 
training. 

The best, by far and away, mentoring process is in this peer re- 
view process that we talked about, where every key decision, every 
test result, every walk down prior to launch, is reviewed by a peer 
group. Now, in that peer group, you want the best expertise and 
the best experience. 

Senator Frist. In the Mars Pathfinder project, how many of 
those employees, workers, members of that team are still with 
NASA now? Are the people that are in there really a part of this 
so-called team? And I have the image, but are they all full-time 
NASA people who are there? 

Mr. Spear. That is a very good point. A large fraction of the 
original Mars Pathfinder team, a young bunch of people, are still 
at JPL, and what a way to carry on lessons learned. They have 
gone on to do projects now. Some of them, however, very close to 
me, are somewhat more scarred than I imagine they would get 
scarred so soon. OK? 

But the experience, on-the-job training is extremely important, 
and then — but this is a very healthy process. The fact that we do 
projects now in 3 years, and we do more than two per decade, we 
do 20 to 30 now, we are going to benefit from this. 

Now, we have had some problems, but NASA soon will have a 
lot of people with experience, real live experience, because the mis- 
sions only take 3 years. That is a very healthy process that is going 
to come out of this, but we are going to have failures, OK, from 
time to time. 

Let me tell you, that is very, very traumatic to these young peo- 
ple, that I know very well. 

Senator Frist. Well, the failures, and then the stress of Mr. Li’s 
findings, and the alternatives that are out there in the private sec- 
tor now, where we have this gap, where there is an age gap, or an 
experience gap? However we define this gap, it is very exciting. 
This experience can build if people stay around, are retained, and 
see a great future with NASA. 

Mr. Spear. Right. 

Senator Frist. Dr. McDonald — and I know it is very late, so I 
have just a couple more questions. Dr. McDonald, pin injection 
problem, break down, and fly what you test, test what you fly ap- 
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proach methodology systems. Are there other instances where that 
methodology was not adhered to, broke down, did not work? 

Dr. McDonald. Not to the best of our knowledge, Senator. We 
would pull on threads as we went through things that looked 
askance, and pull on those threads and go into them, but that was 
the only case we could find of a direct ignoring the regulation, yes. 

Senator Frist. Mr. Spear, cost caps, International Space Station, 
do you believe that Mr. Goldin could apply the successful lessons 
that you have learned managing Pathfinder under a cost cap-type 
scenario? 

Dr. McDonald. It is my personal belief that all projects can em- 
ploy the Faster, Better, Cheaper approach, and work with account- 
ability to a cost cap. Now, that is not to say that they tried to stuff 
an arbitrarily large, say, a challenging large scope into an arbitrary 
cost cap, but they have been given the opportunity to work from 
the bottom up, a good cost estimate, and then declare to NASA, to 
Dan Goldin, hey, I am going to do this task, on this schedule, and 
under this cost cap. I am a firm believer that most work within 
NASA should be done that way, across the board. 

Senator Frist. Then you would understand my frustration a bit 
earlier in questions to Mr. Goldin. The fact that I cannot get cost 
estimates for a project, he cannot get it from his contractor, and if 
you cannot even get the cost estimates, you much less cannot have 
the cap or the accountability built in to it. 

Dr. McDonald. That’s the problem. 

Senator Frist. Mr. Stephenson, eight failure investigations that 
your Board examined, each one suffered from poor and inadequate 
technical reviews. Who traditionally performs these technical re- 
views? Is it the prime contractor? Is it people from within NASA? 

Mr. Stephenson. It’s a combination of both. It depends on what 
programs we are talking about. In the case of the Mars program, 
there was a shift to rely on the spacecraft’s contractor, in this case, 
Lockheed Martin, to conduct the reviews on the spacecraft design 
development and readiness for flight. 

On other programs, where NASA is more integrated, and we 
think we should move to more integration from NASA, and more 
involvement in institutionalized line management, in that case, 
being JPL’s technical experts being involved in the reviews, we 
think that is where we should be going more, and not have this re- 
liance on a contractor to make the right decisions without any in- 
sight from NASA. 

Senator Frist. Thank you. Well, again, the hour is late, and I do 
want to thank each of our witnesses for taking time, being patient, 
and being with us for this afternoon. Your expertise, your knowl- 
edge, and your input are absolutely crucial, as you can tell from 
our questions, to our fully understanding the very complex issues 
confronting NASA today. 

The recommendations of all of your reports and the usual out- 
standing testimony of GAO goes a long way in helping us answer 
our questions, and ask the right questions of NASA, as we go for- 
ward. 

We will continue in this Subcommittee and in the full Committee 
to review NASA activities as additional reports come on-line over 
the coming weeks and months. As you have heard, NASA will be 
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coming back in a few months, after we have had time to digest fur- 
ther all of the reports, to digest the Young report, which will be out 
shortly. 

Again, I want to thank all of you for participating in today’s dis- 
cussions, and thanks again to all of the members of your respective 
review teams who have put forth the time and the effort to make 
these reports possible. Thank you. 

[Whereupon, at 4:58 p.m., the hearing was adjourned.] 



APPENDIX 


Response to written questions submitted by Hon. John McCain to 

Allen Li 

Question 1. You mentioned that there are twice as many workers over 60 years 
old than there are under 30 years old. What percentage of the overall workforce 
does this over 60 years old represent? Also, in what areas are these workers found? 

Answer. This statistic refers to personnel in NASA’s Office of Space Flight (OSF). 
It was provided to us as part of NASA’s “Core Capability” Critical Staffing Review 
dated December 10, 1999. Specifically, the data shows that for fiscal year 1999, the 
workforce over 60 represented 8 percent of the OSF total, or 407 workers. Workers 
under 30 represented 3 percent of the total workforce, or 144 workers. 

According to NASA’s data, these categories of workers are represented in four 
general classifications, including science and engineering, professional administra- 
tive, clerical, and technicians. 

Question 2. Given the uncertainties related to the future of Shuttle privatization 
and commercialization plans, what impact are they having on the overall program, 
both current and future? 

Answer. NASA has not established a schedule for the privatization and commer- 
cialization of the Shuttle. In November 1999, a Space Shuttle independent assess- 
ment team found that, because the milestones for privatization and commercializa- 
tion were uncertain, there was no foundation from which NASA could accomplish 
strategic planning and workforce deployment. The study recommended that NASA 
should begin the analysis of how its workforce will evolve in the privatization and 
commercialization environment and prepare a plan for this evolution. 

NASA took a step toward privatization with the award of the space flight oper- 
ations contract, but full privatization has not been accomplished. Regarding com- 
mercialization, there are currently federal laws and regulations that limit the Shut- 
tle’s ability to fly commercial payloads. 

Although NASA does not have an approved plan for privatizing and commer- 
cializing the Shuttle, the Office of Space Flight is reviewing laws, regulations, and 
policies that are seen as barriers to achieving that goal. 

Question 3. Can you elaborate further on your human capital checklist? Which 
agencies are employing it? 

Answer. The checklist is still in discussion draft form. It is our understanding 
that a number of government organizations are reviewing it and have expressed in- 
terest in applying it. These organizations include the National Partnership for Re- 
invention, the Office of Personnel Management, the Office of Management and 
Budget, and the Environmental Protection Agency. To our knowledge, NASA is the 
only agency that has provided written comments regarding their actual use of the 
checklist. 

Question 4. Your statement mentioned that many key positions are not staffed by 
qualified workers. Can you elaborate on this? Are you saying that some functions 
are being performed by unqualified personnel? Is this a violation of established 
NASA procedures? 

Answer. See Question 5. 

Question 5. You mentioned that an earlier study found there was one qualified 
person in 30 critical system areas. How is “qualified” being defined? 

Answer. We did not intend to leave the impression that “unqualified” workers 
were tending to key Shuttle program positions. The issue we raised is captured by 
Question 5. That is to say, while NASA maintains that its front line Shuttle work- 
force is qualified, there are many areas in which redundancy and depth are lacking. 
NASA’s Space Shuttle Independent Assessment Team (SIAT) report also spoke to 
this issue. It concluded that “there are important technical areas that are staffed 
one-deep.” The example we used in Question 5 relates to Shuttle personnel at Ken- 
nedy Space Center. 
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Question 6. Your testimony stated that during a recent Shuttle wiring investiga- 
tion, personnel unexperienced in wiring issues were used to perform critical inspec- 
tions. Has GAO work confirmed this finding? 

Answer. The study we referred to is the SIAT report. The team expressed a con- 
cern that reductions in staff make it difficult to ensure that critical flight safety 
processes and procedures are being rigorously implemented and continually im- 
proved. The team also expressed the belief that Shuttle program workforce aug- 
mentation must be realized with NASA personnel rather than contractor in these 
critical areas. In this context, the team concluded that, because of workforce short- 
ages, NASA had to use quality assurance personnel who, although certified, lacked 
specific experience with wiring issues. In general, our work confirms the concerns 
expressed by the SIAT report. 


Response to written questions submitted by Hon. John McCain to 

Tony Spear 

Question 1. One of your recommendations is to improve the participation of uni- 
versities in space missions. Can explain the merits of this approach? 

Answer. Witness did not respond. 

Question 2. Would you suggest adjusting current project schedules to avoid the 
risk of excessive cost-cutting? That seems to be your overarching sentiment in your 
testimony as a result of your vast management experience. 

Answer. Witness did not respond. 

Question 3. Do you believe that Mr. Goldin’s “no prescription for success” strategy 
is the right approach to resolving these management problems given the prescrip- 
tive nature of some of your recommendations? 

Answer. Witness did not respond. 

Question 4. In the Faster, Better, Cheaper report, Colonel Pete Rustan, the Clem- 
entine Project Manager, is quoted by saying that “careful FBC pre-project planning 
and costing are as important as ever before.” Has NASA applied those principles 
to the International Space Station and other ongoing projects? 

Answer. Witness did not respond. 

Question 5. Is NASA adequately and aggressively taking steps to reverse the tal- 
ent drain that is outlined in the Faster, Better, Cheaper report? 

Answer. Witness did not respond. 

Question 6. If technology is the key to implementing the Faster, Better, Cheaper 
strategy, what happens to Mr. Goldin’s paradigm if technological advances do not 
occur quickly enough? Does Faster, Better, Cheaper still work? 

Answer. Witness did not respond. 


Response to written questions submitted by Hon. John McCain to 
Arthur G. Stephenson 

Question 1. You stated in your written testimony that the processes in place on 
the Mars Climate Orbiter did not catch the root cause. Can you please describe 
these processes and why they were inadequate? Is NASA still employing them fol- 
lowing your investigatory report recommendations? 

Answer. The process in place on MCO did not catch the unit conversion error or 
the inability of the teams at JPL and Lockheed Martin to get together and discover 
the navigation error. One process was the process of raising concerns and formally 
logging those concerns so that the concern was formally addressed. The Navigator 
did raise a concern to his supervisor but it was not formally documented. Another 
process that failed was the design review process. Although design reviews are 
standard practice, the navigation process was not reviewed. 

Following our MCO report and other Mars failure reports, NASA took steps to 
place more rigor into these processes, thereby greatly reducing the likelihood of this 
type of problem in the future. As we said in the MCO report, errors will occur, the 
process will breakdown at times, but there needs to be checks and balances in the 
system to catch these errors. I think NASA has put processes in place now to catch 
errors. 

Question 2. According to your testimony, you believe that if neither additional re- 
sources nor a reduction in project scope is achievable, then project management 
should recommend cancellation rather than proceed with a project that carries too 
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much risk. Can you apply this dilemma to any current projects at NASA? Do you 
believe that other project managers would agree and carry out your management 
principle? 

Answer. I believe cancellation is better than proceeding with a project that is too 
risky. Usually a high-risk program can be brought to a reasonable risk but only 
with the infusion of additional funds. If the cost/benefit does not warrant the addi- 
tional funds needed, then the project should be cancelled rather than carry excessive 
risk. This past week, I announced cancellation of the X-34 project for this very rea- 
son. I believe other NASA managers are willing to do the same (i.e. Pluto Kuiper 
cancellation). 

Question 3. What are the major technological breakthroughs that would enable 
NASA to cut costs and effectively integrate Faster, Better, Cheaper agency-wide? 

Answer. The major technical breakthroughs that would enable NASA to cut costs 
and effectively integrate Faster, Better, Cheaper (FBC) Agency-wide are program or 
project specific. What would make one program FBC is not the same as another. 
One technology breakthrough area that applies to all NASA space programs is lower 
cost, higher reliability space transportation. Every project NASA undertakes that in- 
volves going into space requires launch and often in-space transportation systems. 
If we can dramatically lower the cost of access to space and space travel, we can 
dramatically change the commercial, military and scientific impact on earth that de- 
rives from space assets. 

The Space Launch Initiative is designed to lower the cost of access to space by 
developing more reliable, lower cost-to-operate second generation reusable launch 
systems. This will be done by funding risk reduction activities, like space launch ar- 
chitecture option studies and funding risk reduction technology development, like 
lower cost, higher reliable reusable propulsion systems. 

NASA’s Advanced Space Transportation Program addresses third generation reus- 
able launch systems that will approach airline-like operations into space. 

Question 4. Do you believe that Mr. Goldin’s “no prescription for success” strategy 
is the right approach to resolving these management problems given the prescrip- 
tive nature of some of your recommendations? 

Answer. Mr. Goldin agrees with the findings and recommendations of the NASA 
Integrated Action Team (NIAT) report. This report reviewed and integrated the rec- 
ommendations of four reports — two related to Mars failures, one that addressed 
FBC philosophy and one that addressed the Shuttle. The NlAT report has specific 
recommendations, some coming from the MCO Committee I chaired. At the end of 
the day, the best practices (“prescriptions”) are dependent on the people who do the 
work. That is what I think Mr. Goldin meant by there are “no prescriptions for suc- 
cess.” NASA and NASA’s contractors employ excellent people. NASA and industry 
senior management must instill a culture that does not allow risks to be excessive 
while encouraging projects to stretch to new levels. Only experienced, well-trained 
leaders will get it right. Mentoring, training, and hands-on experience along with 
well grounded procedures and processes are key to the success we are counting on. 


Response to written questions submitted by Hon. John McCain to 
Daniel S. Goldin 

Question 1. Given yesterday’s press article on the Mars Polar Lander and the 
Young report, have you personally reviewed the report? If so, do you feel that Dr. 
Stone’s statement on “difficult times ahead” applies across NASA as well? 

Answer. Mr. Young and his team did a fine job and provided NASA with a very 
thorough review. This report has caused us to step back for a moment and rethink 
our approach with regard to some of our missions. I still believe that faster-better- 
cheaper is the right direction for NASA, but it has become clear that perhaps we 
pushed a little too hard, too fast. We are looking at all of our programs to ensure 
that we have the right mission scope and the appropriate resources identified to en- 
sure mission success. This review has identified some programs that need to be re- 
aligned — Outer Planets is a prime example — and we are doing that now. We’ve also 
found programs that are exactly on the right track. I think this kind of review is 
a valuable tool. We will continue to undertake efforts to drive down mission costs 
but will seek to more carefully assess and manage risk as appropriate to different 
types of missions in the future. We made some mistakes; now we are learning from 
them and moving ahead so that we can continue to deliver the science results that 
the American public both expects and deserves. 
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Question 2. Should the Shuttle orbiters be re-examined given the use of unquali- 
fied personnel during last year’s test? 

Answer. Our research into this question failed to show that “unqualified” per- 
sonnel were used. In addition, we reviewed again the Space Shuttle Independent As- 
sessment Team report (released on March 7, 2000) and found no mention there to 
use of “unqualified” personnel. Space Shuttle program policy has been and will be 
to use only qualified personnel for every aspect of system processing and launch and 
landing operations. Lessons learned from each flight (In-Flight Anomalies and prob- 
lem reports) will be addressed in a timely manner and so as to assure that process 
changes include workforce training. 

Question 3. If “acquiring, motivating, and keeping good people,” is one of the top 
priorities of NASA to ensure the future of Faster, Better, Cheaper, why have you 
continued to cut or stagnate the agency’s funding for academic programs over the 
last few years? Doesn’t NASA actions contradict what you’re saying? 

Answer. In recent years, NASA has been increasing its budget and expenditures 
for training and development of the Agency workforce. Our expenditures in these 
areas have increased from $30 million in 1997 to over $47 million in 2000 — from 
2.5 percent of salary in FY 1997 to 3.6 percent of salary in FY 2000. In concert with 
discontinuing downsizing and beginning to hire and revitalize the workforce, the 
Agency has encouraged an environment of continual learning so that employees can 
possess leading edge skills and competencies to fulfill NASA missions. In order to 
foster such an environment, we plan to expand delivery methods being utilized to 
develop the workforce and to develop e-learning alternatives that can be accessed 
at all locations and levels, increasing the ability to expand participation across the 
Agency. New capabilities are also being developed to facilitate learning within intact 
teams, delivering learning experiences tailored to a project team at the point in time 
it is needed. In addition, some Centers are also increasing their resources for Cen- 
ter-specific needs. Other learning alternatives which require very little funding are 
also being emphasized, such as providing hands-on developmental experiences, men- 
toring of lesser experienced employees by more senior members of the workforce, 
and other career development initiatives. We continue to emphasize training and de- 
velopment in the areas of systems engineering, high quality technical training, 
project management, and leadership skills. We have also taken steps to encourage 
additional advanced academic study and attendance at technical conferences and 
symposia by providing additional funding to NASA Centers specifically designed for 
these purposes. 

With respect to Academic Programs, designed to serve the needs of the education 
community and inspire an interest in math and science in students at all grade lev- 
els, NASA’s FY 2001 request of $144 million for Academic Programs represented an 
increase of 12 percent over the FY 2000 enacted level (minus Congressionally di- 
rected programs). This request maintained a core program of $100 million with an 
additional $44 million embedded in the Enterprises, as shown below. 
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NASA Funding for Academic Programs 

(in Millions of Dollars) 



Actual FYOO 

NASA FY01 

Request 

Actual FY01 

Baseline Pro- 




gram 

Enterprise 

100 

100 

100 

Contribu- 

tions 

29 

44 

44 

Total Base- 




line Pro- 
gram 

129 

144 

144 

Congres- 




sional 

Add-ons * 

39 

0 

33 

Total Fund- 




ing 

168 

144 

177 


* Congress added funds for specific programs designated for a particular fiscal year that were not included 
in NASA’s request. 

Even in times of declining budgets NASA has made a commitment to maintain 
the stability of the Academic Programs budget. We believe this represents a strong 
commitment to invest in the future science and technology workforce and in greater 
scientific and technological literacy in general, which is the Nation’s foundation for 
future discoveries and economic prosperity. This is truly an investment to embark 
on a bright new future. 

Question 4. You mentioned in your written statement that you will not issue a 
“prescription for success” to the NASA workforce. Can you elaborate on this asser- 
tion? Does this mean you plan to let them solve their own problems? 

Answer. As an agency responsible to the American taxpayers, NASA can be jus- 
tifiably proud of its scientific and technological success during the past decade, par- 
ticularly in light of accomplishments achieved while faced with budgetary and work- 
force reductions. Nonetheless, we strive to continually understand our present state 
and analyze what needs to be done to plan a path of continual improvement. We 
do not want to issue a “prescription for success” to the NASA workforce if it is a 
one-size-fits-all prescriptive checklist that must be rigidly adhered to. This would 
stifle the very innovation that we strive to enhance within our talented workforce. 
Instead, we are providing general principles and guidelines that can be tailored and 
allow for innovation. Based upon tbe Mars program failures and other activities, the 
Agency recognized the need to assess and respond to various findings and rec- 
ommendations that could be more broadly applied to a wide range of NASA pro- 
grams and projects. This resulted in an assessment chaired by the NASA Chief En- 
gineer and an analysis and report of the NASA Integrated Action Team. This report 
found that to be successful in our project planning and execution, there remain sev- 
eral elements that must be considered which are indicators of future success. 

The people of NASA and its partners are the linchpins of our present and future 
success. Challenging work, executed in a safe and productive work environment by 
people who are well prepared for and supported in their work is an essential ele- 
ment to successful project planning and execution. Well-defined and executed formu- 
lation and implementation is also required. These processes must be driven by thor- 
ough understanding and controlling of risks, where open communication will allow 
for problems to be found early, and when tbe right people can be involved and re- 
sources needed to solve them are less substantial. Innovation needs to be encour- 
aged while integrating sound management and engineering fundamentals. 

State-of-the-art tools and methodologies are also essential. The cutting edge of re- 
search and technology will only be achieved through advancing the way we do work. 
Technology must be cutting edge and advance and address both the needs of today 
and also those of tomorrow. A sustained investment in America’s future through ad- 
vancing technology development will be essential to our Nation’s global competitive- 
ness and leadership. 

The recommendations of the NIAT report provide a framework and important 
guidelines for us to take NASA into the future. Through this vision for the future, 
we will further strengthen our capability to be effective stewards of the public trust. 

Question 5. Your written statement indicates that NASA’s steps over the past two 
years demonstrate its commitment to a world class system engineering program. 
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How do you explain the findings of several external review reports calling for better 
systems engineering efforts? Also, would you outline how you are incorporating sys- 
tems engineering in the Space Station program given the review two years ago by 
the Cost Assessment and Validation Task Force? 

Answer. NASA takes great pride in possessing a knowledgeable and skilled engi- 
neering workforce capable of world-class performance in the development, integra- 
tion, and operation of complex space systems and aerospace technologies. Over the 
last several years, changes in practice, skills, and knowledge of the workforce, cou- 
pled with the demand for innovation in aerospace science and technology, particu- 
larly the revolution in information technologies, presented a tremendous challenge 
to NASA. 

NASA is committed to the revitalization and sustainability of its engineering ca- 
pability. With the support of the Administration and Congress, NASA has started 
to fill critical engineering and other skills essential to health and safety of the Shut- 
tle and ISS programs. In February 2000, the NASA Administrator created the posi- 
tion of Deputy Chief Engineer for Systems Engineering. This position was estab- 
lished to develop the vision, objectives, and strategies for the development and 
maintenance of the Agency’s world-class engineering capability in the Agency. 

In March 2000, NASA released a series of reports that were the product of activi- 
ties chartered by the Agency in response to failures in the Mars Program, Shuttle 
wiring problems, and a generic assessment of NASA’s approach to executing “Fast- 
er, Better, Cheaper” projects. Some of the specific recommendations on systems en- 
gineering contained those reports were: 

Mars Climate Orbiter (MCO) report 

• Establish and fully staff a comprehensive systems engineering team at the start 
of each project. 

• A core group of system developers and systems engineering personnel should 
assist the operations team in developing nominal and contingency procedures, 
mission rules and operational. 

Mars Program Independent Assessment (MPIA) 

• Appropriate levels of systems engineering need to be in place throughout the 
formulation and implementation phases of all projects. 

Also in March 2000, the Office of the Chief Engineer chartered a NASA-wide sen- 
ior team, the NASA Integrated Action Team (NIAT), to develop an integrated Agen- 
cy strategy to respond to the recommendations of these reports. The NIAT report, 
released in December 2000, made several observations regarding systems engineer- 
ing. It said that “The reports expressed concern as to the consistency of competency 
across teams in light of the need to establish teams that are multiskilled, including 
systems engineering, operations, and scientific expertise.” It went on to say that 
“The increased number of projects amplified the challenges on the systems engineer- 
ing pool by placing equal demands for project managers from the same talent pool.” 
In the section of the report addressing the need to revitalize engineering capability, 
the NIAT report discusses “the need for a comprehensive plan to ensure a world- 
class engineering capability that includes the development and application of ad- 
vanced engineering tools and capabilities. Much of this effort will focus on strength- 
ening capabilities in systems engineering.” 

The report concludes that an “ingredient in the assessment of NASA’s engineering 
capability is consistency in process, and execution. Over time, each of the NASA 
Centers has developed internal processes for systems engineering that have made 
them largely successful in their mission. However, as we strive for greater integra- 
tion, consistency, and sharing of expertise among NASA Centers, industry, and aca- 
demia in collaborative environments, it appears that the Agency could benefit from 
appropriate Agencywide standards in the systems engineering process.” Further- 
more, it concludes that “Specific considerations are needed for systems engineering 
skills at the “mission” level, and below, to ensure the “systems” perspective is main- 
tained at all levels throughout the life cycle.” 

Some of the NIAT recommendations specific to systems engineering capabilities 
are: 

• Enhance education and training for engineering capability including real-world 
hardware experience and partnering with academia to develop curriculum such 
as systems engineering, advanced engineering environment, risk assessment, 
and cause-and-effect analysis tools and methods. 

• Develop Agency-wide process standards, requirements and guidelines for the ef- 
fective implementation of systems engineering in programs and projects. 
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The proactive steps taken by NASA over the last two years demonstrate the Agen- 
cy’s commitment to the sustenance of a world class program/project management, 
and systems engineering capability. The concerns raised by the reports are a re- 
minder that the NASA business is inherently high risk, and that as steps are taken 
to further improve the program/project management and systems engineering capa- 
bility, we must remain ever vigilant to minimize the probability of failures that are 
preventable. 

NASA has taken a very broad view of the systems engineering for the Space Sta- 
tion and integrated that function across NASA and the contractor activities. Devel- 
opment, systems integration and sustaining engineering activities are all managed, 
including contractor technical oversight, in a single NASA organization (see chart 
below). As the development phase is incrementally completed critical skills are 
transitioning to sustaining engineering to support the assembly stages. 



Vehicle Office 



Recently, the Space Station program began a major activity to assure continuity 
of skills and a seamless handoff from development to operations was the initiation. 
In late 1999, a statement of work for Integration and Operations (I&O) was initi- 
ated within the prime contract. The transition planning and skills retention is now 
taking place through this portion of the contract. The same engineers who are cur- 
rently, and have been, designing, building and integrating the Station are working 
on the I&O contract to assure its safe and effective operation. 

NASA has clearly delineated and documented the systems integration responsibil- 
ities for which each party is accountable and currently performing. 

Question 6. What is NASA’s response to the Comptroller General’s checklist for 
human capital management? Is it being used at NASA? Where and to what extent? 

Answer. NASA has applied the checklist’s framework to its human resources pol- 
icy and oversight functions in several ways. In developing the Office of Human Re- 
sources and Education Functional Leadership Plan last year, we reviewed and incor- 
porated into our thinking the basic principles from the Comptroller General’s check- 
list for human capital management. The final plan is based on the strategic concept 
that “Our greatest strength is our workforce” and mirrors basic principles reflected 
in Part 1 and 2 of GAO’s checklist. Secondly, since the mid-eighties, NASA has been 
recognized for its strong human resources’ self-assessment program. The core com- 
ponent of our program is local accountability, with Agency guidance in the form of 
a reviewer’s complete checklist on merit principles and other national goals in law 
and regulations. This approach relates to the GAO checklist’s cross-cutting consider- 
ations. Moreover, in January 2000, we incorporated the GAO checklist as a com- 
panion piece to our self-assessment protocol. Finally, we have used, and plan to con- 
tinue to use, basic premises of the checklist as guidance when reviewing the effec- 
tiveness of our human resources programs to identify additional needs and enhance- 
ments. One recent example was the development of our Agency’s improvement plan 
in response to National Performance Review survey results. 

Question 7. What is NASA doing to address recruitment of new employees, espe- 
cially software engineers, to meet both current and future program needs? How can 
NASA remain competitive with the alluring packages of the high tech industry? 
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Answer. We must be innovative and energetic in our efforts to attract the best 
and the brightest to NASA. The most effective recruiting tool we have is the NASA 
mission. People generally come to work for NASA not for the money or benefits, but 
because they enjoy the work and want to be a part of the mission. We need to take 
full advantage of the attractiveness of our mission, but that alone is not enough. 
While NASA will never be able to match some of the compensation packages offered 
by the private sector, we must do our best to narrow the gap so that we are at least 
competitive. This will require using the financial incentives at our disposal, empha- 
sizing the non-financial incentives, streamlining the hiring process, participating in 
programs that provide sources of future talent for the Agency, and being active in 
a wide array of recruitment initiatives. 

Our Centers use various financial incentives in order to make competitive job of- 
fers. Special salary rates are in place for some hard-to-fill occupations, covering 
many of NASA’s scientist, engineering and engineering software positions. To make 
offers more attractive, our Centers are able to offer starting salaries above the min- 
imum rate of a grade through the superior qualifications appointment authority. 
They offer recruitment bonuses to attract exceptional candidates to NASA. Very 
soon they will have a new financial incentive available for their use: the authority 
to repay federally insured student loans. In offering jobs, we emphasize the entire 
Federal package — not just the starting salary level — since our retirement, health, 
leave, and life insurance programs are competitive with those offered by many pri- 
vate sector companies. We also emphasize the other benefits we can offer such as 
flexible work schedules, family friendly programs, an array of professional develop- 
ment opportunities, and tuition support. 

Unfortunately, despite these incentives, many of our new employees must still 
make a personal or family sacrifice in order to work for NASA. The alluring pack- 
ages (salary and benefits) offered by high tech industry cannot be matched by 
NASA. The impact is national in scope but is particularly acute for NASA Centers 
located in higher cost of living areas. The fierce competition for information tech- 
nology workers, including software engineers, puts NASA at a competitive disadvan- 
tage. 

We are committed to marketing NASA as the “employer of choice.” One of our 
greatest advantages in competing for the best and the brightest is our ability to ex- 
cite individuals about NASA’s mission, commitment to excellence, and professional 
challenges and opportunities. 

In order to compete with employers who have streamlined hiring procedures, we 
are automating our processes with software that will enable individuals to apply for 
our jobs easily and receive timely responses. 

We recognize that we must have a continuing presence on college and university 
campuses to maintain an effective influx of college graduates into NASA. The more 
than 140 on-campus recruitment trips scheduled over the next year are typical of 
this presence. We plan to continue to use the Presidential Management Intern Pro- 
gram and student employment programs as sources for entry-level hires as well. In 
order to recruit more effectively with the cooperative education program, we are de- 
veloping new qualification requirements for these students. A new hiring authority 
recently established, the Federal Career Intern Program, soon will be available as 
another tool for hiring quality candidates under streamlined procedures. 

Another means of developing a future pipeline of talent from which NASA can 
draw is the NASA Undergraduate Student Research Program, piloted in FY 2001. 
One of its purposes is to provide undergraduates with challenging research experi- 
ences that stimulate continued interest in the disciplines aligned with NASA’s mis- 
sion. Another is to build a national program bridge — from existing NASA K-12 Edu- 
cation Program activities to NASA Higher Education Program options — to encour- 
age interest in future professional opportunities with NASA. 

Our marketing techniques and efforts have become more expansive in order to 
compete in today’s environment. We established a unified NASA jobs web site to 
provide easy access to information on jobs, with direct links to information on 
NASA’s mission and Centers as well as links to the application procedures. We will 
continue to promote the Internet as a recruiting tool. A new National Recruitment 
Team, based at Headquarters, is being established to develop new Agency-wide re- 
cruitment strategies and tools to meet NASA’s current and future hiring challenges 
in attracting and retaining a world-class, highly technical and diverse workforce. 
This team will facilitate and complement the Centers’ recruitment efforts; collabo- 
rate with the Institutional Program offices and Functional Offices, enhance relation- 
ships with universities, and facilitate targeted diversity and disability recruitment. 
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Question 8. You mentioned that Station runout costs have decreased by $1.2 bil- 
lion, of which $.8 billion is due to a shift of tiding for the Crew Return Vehicle to 
another budget account. What is the rationale for this transfer? 

Answer. The statement was made in the context of the Station funding line. Dur- 
ing the formulation of the FY 2001-2005 budget, the Agency reallocated the FY 
2002-2005 funding estimates for the Phase 2 (production phase) of the CRV to the 
Science, Aeronautics and Technology (SAT) account as part of the funding for the 
Space Launch Initiative. The funding is in SAT pending a decision on whether to 
proceed with an X-38-based CRV design (which could only be used for emergency 
crew return from the Space Station) or a design that could also provide a crew 
transfer function to bring crew to and from orbit as part of a new space transpor- 
tation architecture. This decision is within the context of broader decisions that 
NASA and the Administration will make regarding future space transportation ar- 
chitectures. A design decision on whether to follow the X-38 path or to incorporate 
alternative design concepts is expected to be made within two years. 

Question 9. Who pays for the efforts to correct problems on the X-33 program? 

Answer. NASA and Lockheed Martin have negotiated an extension to the coopera- 
tive agreement that extends the Period of Performance from December 31, 2000 to 
March 31, 2001. The agreement allows Lockheed Martin to re-plan the flight sched- 
ule based on recovery from the composite tank failure. No additional funding has 
been added to the cooperative agreement. NASA’s investment of $912 million re- 
mains fixed. 

Question 10. What will NASA do if the industry partner decides to discontinue 
the X-33 project? 

Answer. If Lockheed Martin chooses to discontinue the X-33 project, the project 
will be terminated. As a result of the negotiations to extend the cooperative agree- 
ment, the government has the right to request the transfer of the title of ownership 
for all X-33 hardware and data. 

Question 11. How can you state that “NASA has saved approximately $40 billion 
from planned budgets for the American taxpayer and is doing more for less,” when 
the International Space Station has experienced cost overruns and increases over 
$9 billion and we just lost two Mars missions worth $360 million? Where is the sav- 
ings to the American taxpayer? How can I explain this to my constituents in Ten- 
nessee who want to know what their investment is funding? 

Answer. Failures and cost overruns are expected when the implementation of 
technology is pushing the state-of-the art; and projects with the highest risk are 
often the ones that reap the biggest benefits with the highest payoffs in the future. 
While some of the projects at NASA have experienced problems, most have not. Be- 
tween 1992 and 2000, NASA launched 146 payloads valued at a total of $18 billion. 
Of this number, 136 payloads were successful. We believe our success is a testimony 
to NASA’s strong systems engineering capability. Our total losses amounted to 10 
payloads, measured at about $500 million, or less than 3 percent. The Mars 1998 
failures alone accounted for 60 percent of this loss. Planetary spacecraft, which used 
to be launched twice a decade at a cost measured in the billions, are now routinely 
launched each year at a small fraction of that cost. 

Question 12. Given the problems on the X-33 program, is it time for NASA to pur- 
sue an incremental approach to technology development rather than the evolution- 
ary one used on the X-33 program? 

Answer. NASA has undertaken a Space Launch Initiative and developed an Inte- 
grated Space Transportation Plan to pursue new approaches to reducing NASA’s 
space transportation costs. A brief description of ISTP and SLI follows but more in- 
formation can be found on the web at http://std.msfc.nasa.gov/spacelaunch.html. 

The goal of the Space Launch Initiative (SLI) is for NASA, by 2010, to meet its 
human space flight needs on commercial launch vehicles that will reduce costs and 
improve safety. If successful, SLI will dramatically alter the economics of space 
launch. SLI is based on lessons learned by NASA and industry from working to- 
gether on the X-33, X-34, and X-37, and on inputs from Space Transportation Ar- 
chitecture Studies commissioned by NASA and led by industry over the past two 
years. The initiative is designed around four principles: 

• Commercial Convergence — flying on privately owned and operated launch vehi- 
cles 

• Competition — bringing innovation and new ideas to bear 

• Assured Access — ensuring alternate means of getting to space despite launch 
mishaps 
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• The Ability to Evolve — adding new capabilities affordably as new mission needs 
emerge. 

SLI is funded at $4.5 billion over five years ($290 million in FY 2001 ramping 
up to $1.3 billion per year). NASA is undertaking three major activities through 
SLI: 

• One, invest in technical risk reduction activities to enable competitive, full-scale 
development of privately owned and operated launch vehicles by 2005 (Risk Re- 
duction and Competition, $2.4 billion); 

• Two, develop hardware that can be flown on these commercial launch vehicles 
to meet NASA’s unique needs, such as crew transport (NASA-Unique Systems, 
$1.6 billion); and 

• Three, pursue procurements of existing and emergent vehicles for select Space 
Station needs as a means of providing near-term, assured access and dem- 
onstrating new, innovative approaches (Alternative Access, $300 million). 

In addition to these three major activities, the Space Launch Initiative also funds 
ongoing x-vehicle programs like X-34 and X-37 and critical systems engineering 
and requirements definition activities that will tie these elements together ($200 
million). 

The Integrated Space Transportation Plan (ISTP) is the framework NASA uses 
to coordinate its space transportation investments. Specifically, ISTP coordinates on- 
going investments (Space Shuttle safety improvements, the Crew Return Vehicle for 
the International Space Station, base technology investments in space transpor- 
tation) with investments in new vehicles to reduce NASA’s space transportation 
costs (SLI as described above). For example, Space Shuttle safety investments are 
now focused on improvements that will be fully in place by 2005 so that Shuttle 
can benefit from these safety investments before a potential replacement would be 
available through SLI in 2010. In another example, prior to a full-scale development 
go-ahead decision on a Space Station Crew Return Vehicle, NASA will fully examine 
a range of designs to for other, cost-effective options that meet both the crew return 
need and other NASA-unique needs, such as crew and cargo transport, on future 
launch vehicles developed under the Space Launch Initiative. 

SLI and ISTP differ from previous approaches by providing multiple, competing 
paths to future systems with back-up alternatives. For example, the Space Launch 
Initiative seeks to reduce technical risk for at least two, competing Earth-to-orbit 
launch vehicle designs to enable full-scale development decisions in 2005 with oper- 
ational vehicles by 2010. By pursuing at least two competing designs, NASA intends 
to spur industry innovation and have more than one development path if technical 
issues pose roadblocks to a particular design. If technical issues or market condi- 
tions delay development decisions in 2005 or operability by 2010, ISTP is making 
concurrent investments in Space Shuttle safety to ensure continued U.S. human ac- 
cess to space. In the near-term, the Space Launch Initiative also seeks alternate 
means of access to Space Station for cargo on existing or emergent commercial 
launch vehicles to back-up the Space Shuttle in the near-term. 

With respect to X-33 and other existing x-vehicle programs, decisions on con- 
tinuing investments in those vehicles (e.g., a re-planned flight schedule for X-33) 
will be tied to industry proposals under the larger Space Launch Initiative to reduce 
technical risk and prepare viable, competing designs for the 2005 competition. In 
this way, ISTP coordination and Space Launch Initiative goals provide an important 
context for decisions on specific space transportation investments. 


Response to written questions submitted by Hon. John McCain 
to Dr. Harry McDonald 

Question 1. Your statement mentioned a “success engendered safety optimism.” 
Can you elaborate on what that term implies? 

Answer. The Shuttle is a complex, well-defended, yet aging system that operates 
in an unforgiving flight environment and requires extensive, often intrusive mainte- 
nance. In its review, the SIAT observed an “erosion” of some Shuttle safety-critical 
defenses. Although the perceived erosion is attributable to a number of different fac- 
tors, one factor of concern to the assessment team is “success engendered safety op- 
timism.” Success engendered safety optimism refers to the tendency to accept risk 
solely because of prior success. The manifestations of this tendency may include: the 
assumption that risk decreases over time with each successful launch; the percep- 
tion that the Shuttle is now an “operational” vehicle requiring only routine atten- 
tion; the discounting of precursor incidences; and the reliance on redundancy for 
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risk management. Because past success does not preclude the existence of problems 
in processes and procedures that could be significantly improved, the SIAT believes 
it is imperative that the SSP rigorously guard against success engendered safety op- 
timism. 

Question 2. You mentioned that risk management erosion was created by the de- 
sire to reduce costs. Who led this cost reduction effort — NASA or the operations con- 
tractor? 

Answer. The cost reduction effort, part of the overall effort to privatize and 
streamline Shuttle operations in the mid-90s, was led by NASA in response to the 
past Administration’s directives. 

Question 3. You also mentioned the need for more frequent turnover on the Aero- 
space Safety Advisory Panel. Can you elaborate on the current membership format 
and tenure and the type of expertise that needs to be added? 

Answer. The Aerospace Safety Advisory Panel is an independent group of experts 
consisting of nine members who are appointed by the NASA Administrator. As stat- 
ed in its charter, appointments are for 6 years and reaffirmed annually. To provide 
continuity of service and preserve integrity, not more than one-third of the Panel 
members may be appointed every 2 years. Consultants are appointed as needed by 
the Panel Chair, with the concurrence of the Administrator, and reaffirmed annu- 
ally. 

The tenure of individual Panel members currently averages almost 11 years, with 
one member serving since 1977, and a former member, now a consultant, serving 
continuously since 1982. An ISO 9000 Headquarters OfficeWork instruction, dated 
April 14, 2000, addresses the appointment of new ASAP members. Central to this 
process is the determination of additional expertise needed by ASAP to perform its 
function. Additionally, issues of tenure and renewal are being vigorously addressed 
in the revised ASAP charter which will be signed in April 2001. 

The SIAT believes, and NASA concurs, that a balance must be maintained be- 
tween familiarity and independence to ensure appropriate review. Further, with the 
rapid advance of technologies that may enhance Shuttle safety, members and con- 
sultants with expertise in emerging disciplines will be needed with increasing fre- 
quency. Whereas the current expertise on the panel leans heavily toward estab- 
lished aerospace technologies, new members with knowledge of intelligent systems, 
human-machine interfaces, and vehicle health management, and advanced risk as- 
sessment tools may become important. 

Question 4. You have commented that despite the findings and recommendations 
of your review team and the Aerospace Safety Advisory Panel, workforce stress 
issues remain. Do you feel that NASA’s management will resolve these problems? 

Answer. In performing its review, the SIAT was continually impressed with the 
skill, dedication, and concern for public and astronaut safety of the entire Shuttle 
workforce. The high level workforce performance required by the Shuttle program 
has always created some level of workforce stress; however, the workforce percep- 
tion is that this has increased significantly in the last few years. It became apparent 
to the SIAT that the significant number of changes experienced by the Shuttle Pro- 
gram in recent years has affected workforce morale or diverted workforce attention. 

Observations of workforce issues have been reported consistently by the ASAP 
since 1996. The SIAT was concerned that some of these issues and their potential 
impact on safety were still evident in workforce assessments (e.g., Occupational 
Stress Inventory) and in climate indicators (e.g., overtime hours worked) obtained 
during its review. 

The SIAT was gratified by an immediate response to its findings by NASA man- 
agement whereby they increased NASA Quality Assurance personnel resources for 
Shuttle processing at KSC. The response of the SSP to the SIAT recommendations 
also indicates renewed commitment toward addressing workforce morale and atten- 
tion. As reported to the SIAT, communication processes have been examined and 
improved; access of “floor” personnel to higher management has been increased; and 
workforce analysis studies have been, and will continue to be, used to monitor em- 
ployee stress. Further, teams have been formed to address human factors issues in 
processing, work instructions and environments, and error resolution. Finally, 
NASA management continues to emphasize the development and delivery of state- 
of-art-technology to assist Shuttle personnel in performing their complex activities 
with greater fidelity and safety. 

Question 5. Do you know of any efforts by NASA to address any of your team’s 
recommendations as part of the Shuttle upgrade program? 

Answer. The SIAT did not directly or extensively address Shuttle upgrades in its 
assessment. However, several of the planned upgrades were discussed in the Shuttle 



86 


Program’s response to several of the SIAT recommendations. Specifically, planned 
improvements to the Auxiliary Power Units (APU), the Reaction Control System 
(RCS), and the Orbital Maneuvering System (OMS) were described as addressing 
SIAT recommendations (parts of, or in their entirety) for these subsystems. 

Question 6. You address the erosion of flight-safety critical processes due to a re- 
duction in allocated resources and appropriate staff in your SIAT report. Do you be- 
lieve that Administrator Goldin and other NASA top officials anticipated this ero- 
sion prior to last year when several internal reports confirmed this fact? If so, did 
anyone acknowledge it? 

Answer. The Shuttle program has recently undergone a massive change in struc- 
ture with the transition to a slimmed down, contractor-run operation, the Shuttle 
Flight Operations Contract (SFOC). This has been accomplished with significant 
cost savings and without a major incident. The Administrator and his staff were 
aware that the changes would stress the system and that careful scrutiny would be 
necessary to identify and assess potential erosion in flight-safety critical processes. 
When two in-flight anomalies on STS-93 occurred, they were viewed as potential 
indications of problems related to processing and aging of the Shuttle system and 
the present assessment was initiated. The report’s findings and recommendations 
are being considered seriously and actions taken appropriately. 

Question 7. Your review team suggested in its final report that prior to the next 
Shuttle flight, the Space Shuttle Program should make a quantitative assessment 
of the success of the visual wiring inspection process. Did this occur? What was the 
response to this suggestion from the KSC leadership? 

Answer. The SIAT did recommend that, prior to STS-103 (first flight after STS- 
93), the reliability of the wire visual inspection process be quantified. This rec- 
ommendation was dispositioned at the Pre-Flight Readiness Review held at JSC on 
November 2, 1999. The Shuttle program fulfilled the requirement by performing two 
independent inspections of the wiring in OV103 at KSC and two independent in- 
spections on 0V102 at the Palmdale facility. Reports from the SSP indicate that 
on OV103, the first inspection identified 70-80 percent of wire defects; the subse- 
quent 20-30 percent were found during the second inspection. For the reliability as- 
sessment on OV102, slightly better results were obtained, with 86 percent of the 
total number of defects found during the first inspection. 

Question 8. Do you believe that Mr. Goldin’s “no prescription for success” strategy 
is the right approach to resolving these management problems given the prescrip- 
tive nature of some of your recommendations? 

Answer. As with any independent assessment, benefit comes from a fresh perspec- 
tive, a very refined focus, and being unrestrained by typical constraints. Programs, 
on the other hand, require in-depth familiarity and constant balancing of con- 
straints and goals. The SIAT realizes that its recommendations must be pursued 
within the context of the Shuttle program: while the recommendations are prescrip- 
tive in the sense that they require specific issues to be addressed, there is room for 
expert, creative implementation by the Shuttle program. 

Question 9. Mr. Li’s testimony stated that during a recent Shuttle wiring inves- 
tigation personnel inexperienced in wiring issues were used to perform critical in- 
spections. How serious is this finding in terms of risk to the overall safety program? 

Answer. The SIAT has a concern similar to Mr. Li’s. The specific finding in the 
SIAT report states: “The technicians that are working on the wiring are certified, 
yet some lack detailed specific experience with wiring. Some of these technicians 
have extensive experience working on many Shuttle operations yet limited time in- 
specting and repairing wiring. In some cases the technicians were given training 
just prior to the start of the recent wiring inspection and repair effort.” The SIAT 
gave a recommendation to the Shuttle program to assure that certification of inspec- 
tors and technicians be conducted by experienced domain experts. The Shuttle pro- 
gram has responded that instructors represent the most knowledgeable individuals 
in their field of expertise and that periodic audits and evaluations of certification 
training are performed to ensure training adequacy. 

Currently, visual inspection remains the best defense against wiring faults. How- 
ever, visual inspection is fallible and can actually cause wiring defects because of 
its intrusive nature. As long as visual inspection of wiring is used to discover wiring 
defects, residual risks will remain. Substantial reduction of these risks can be made 
only with the development and deployment of reliable, remote, nondestructive wir- 
ing inspection techniques. 
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